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I.       IMTRQDUCTIQIl 

A.  BACKGROUiJD 

Much  has  been  written  on  the  subject  of  the  quality  of 
products  f.roduceci  for  purchase  under  government  contract  and 
even  rnore  has  been  vjritten  on  the  general  subject  of  quality. 
Surprisingly  little  has  been  written  on  the  quality  of  th.e 
procurement  itself.   This  thesis  will  explore  the  aspects  of 
quality  in  procurement  in  an  attempt  to  discover  what  makes  a 
good  purchase  and  how  the  quality  in  purchasing  can  be 
achieved . 

B.  OBJECTIVES 

The  Navy  Field  Contracting  System  (NFCS)  has  recently 
installed  a  system  known  as  Purchase  Unit  Resourcing  (PUR) 
for  funding  procurement  activities  under  its  cognizance.   The 
PUR  system  funds  activities  based  on  the  number  of  purchase 
documents  completed.   The  overall  attitude  towards  the  system 
has  been  favorable,  however,  one  of  the  major  problems  cited 
witn  it  is  its  failure  to  recognize  the  importance  of  quality 
of  procurement  actions.   As  is  often  the  case  with  any  system 
based  solely  on  quantity  for  performance,  the  PUR  system  is 
likely  to  cause  a  decrease  in  quality  in  the  NFCS. 
Perceiving  this  potential  problem,  the  managers  of  the  NFCS 
have  decided  that  a  system  for  measuring  quality  is  also 
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required  to  insure  that  the  proper  balance  is  maintained 
betvN.'een  quantity  and  quality.   The  goal  of  tnis  thesis  is  to 
study  the  Navy  Field  Contracting  System  and  the  subject  of 
quality  in  general  in  orcer  to  deter rair.e  how  quality 
principles  can  be  applied  to  contr^act  actions. 

C.   RESEARCH  QUESTIOIJS 

Given  the  preceding  general  objectives,  the  following 
primary  research  question  v/as  posed:   iMcv;  can  improved 
quality  of  contractual  actions  be  achieved  in  the  Mavy  Field 
Contracting  System? 

The  follov;ing  ancillary  research  questions  are  deemed 
pertinent  in  addressing  the  basic  research  question: 

1.  What  is  the  definition  of  quality  in  contracting? 

2.  Hovj  is  quality  currently  measured  within  the  fIFCS? 

3.  U'hat  measures  of  quality  are  used  outside  of  the  I'FCS 
and  can  they  be  applied  to  the  NFCS? 

^.      VJhat  specific  methods  should  be  established  to  improve 
the  quality  of  procurer.:en t  actions  within  tiie  IJFCS? 


D.   SCOPE,  LIMITATIONS,  AND  ASSUMPTIONS 

The  thrust  of  this  thesis  is  to  provide  a  management 
guide  to  NFCS  managers  to  improve  the  quality  of  their 
purchase  actions.   The  thesis  is  limited  to  initial 
procurement  rather  than  subsequent  contractual  or 


administrative  actions.   It  focuses  on  procuren.enLs  between 
$1,000  and  $1,000,000  as  those  actions  i:hat  are  the  r.ost 
C0i.ir:)0n  in  the  I'.FCS. 

The  primary  concern  of  the  thesis  is  to  deter:. line  'what 
quality  is  and  then  to  find  a  way  to  apply  quality  to  the 
contracting  process.   There  is  a  vast  and  growing  amount  of 
literature  and  opinion  on  the  general  subject  of  quality.   As 
competition  in  the  private  sector  increaises,  it  is  expected 
that  tne  push  for  quality  will  also  expand.   Rather  than  try 
to  cover  ail  the  different  concepts  and  programs  currently 
offered  on  quality,  this  thesis  is  limited  to  the  concepts  of 
quality  proposed  by  two  of  the  most  distinguished  autnorities 
in  the  field.   The  work  of  Joseph  M.  Juran  and,  more  often, 
W.  Edwards  Deming  are  used  as  the  guide  for  much  of  the 
concepts  expressed  in  this  thesis.   Interested  readers  may 
consult  their  works  as  well  as  others  listed  in  the 
bibliography  for  further  discussion  on  quality.. 

This  thesis  assumes  the  reader  has  a  general  knowledge  of 
thiC  DoD  contracting  language,  and  the  Defense  acquisition 
process.   Additionally,  it  further  assumes  the  reader  has  a 
general  understanding  of  the  organization  of  the  NFCS  and  its 
role  irj  this  acquisition  process. 


E.   METHODOLOGY 

A  combination  of  acquisition  literature  and  telephonic 
and  personal  interviews  regarding  current  practices  within 


the  liFCS  was  used  to  provide  data  for  the  thesis.   The 
literature  base  was  mainly  conipiled  through  the  Defense 
Logistics  Studies  Inf on.ia tion  Exchange,  tae  .'Javal 
Postgraduate  School  Library,  and  a  review  of  various  journals 
and  period  icals  . 

F.   ORGAIJIZATION  OF  THE  THESIS 

This  thesis  attempts  to  take  the  reader  through  the 
subject  at  hand  as  logically  as  possible.   Chapter  II  is 
designed  to  provide  the  reader  with  a  background  on  the  PU.R 
system  as  it  is  currently  being  used  in  tne  iiFCS.   A  general 
discussion  of  quality  and  how  to  achieve  it  will  also  be 
Included  in  this  chapter.   Viith  this  foundation  upon  which  to 
build,  a  presentation  will  be  made  of   current  practices 
within  the  NFCS  in  Chapter  III.   This  chapter  will  also 
include  a  review  of  a  study  conducted  by  students  at  the  U. 
S.  Air'  Foi'ce  Academy  concerning  quality  in  procuremient . 
Chapter  IV  will  present  an  overall  program  for  acnieving 
quality  in  procurement.   Finally,  recoramendations  and 
conclusions  will  be  presented  in  Chapter*  V. 
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II.   FRAMEWORK 


A.   productivl  unit  RESOURCII.'G 

Productive  Unit  Resoiu-cing  (PUR)  is  a  raethoci  of 
resourcing  used  within  the  Naval  Supply  Systeias  Coniir.and 
(NAVSUF)  to  fund  its  field  activities  by  productive  output 
[Ref  1:p.  1].   Although  the  PUR  program  applies  to  almost  all 
areas  under  NAVSUP  cognizance,  this  thesis  will  limit  its 
scope  to  the  use  of  PUR  in  the  contracting  environment. 

The  heart  of  the  PUR  system  is  in  funding  the  activii:y  by 
productive  units  completed.   In  the  contract  ar^ena,  the  PUR 
prograra  ties  funding  to  purcnase/ccn  trac  t  actions  completed. 
Activities  are  funded  on  a  rate  per  contract  action  with 
different  rates  for  both  small  and  large  purchase.   This  rate 
is  obtained  by  dividing  total  costs  of  the  contract/purchase 
operation  by  the  number  of  actions  completed.   Costs  that  are 
included  in  the  rate  calculation  include  large  or*  small 
purchase  buying  costs,  contract  or    purchase  administration 
costs  and  procurement  overhead  costs.  The  buying  and 
administration  costs  consist  mostly  of  salaries  and  the 
overhead  costs  include  items  sucn  as  prccuremient  printing. 
These  costs  are  added  together  and  divided  by  the  num-ber  of 
purchase  actions  corjpleted.   In  the  case  of  large  contracts, 
each  type  of  action  is  given  a  weight  as  noted  in  Table  1 
[Ref  1 :p.  10] . 
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TABLE  1  -  PRODUCTIVE  UI.'IT  './EIGHTS  3Y  CCiiTRACT  ACTIOii  TYPE 


COin'RACT  TYPE 

Dei  order/GSA/Other  Fed  A~e 
Sealed  Bids 
Unpriced  30A  Orders 
Initial  Placenient  of  EGAs/ 
Contracts  u  IDTCs  <  $251< 

Definitized  BOA  Orders 
25k  to  <  100k 


ICOk 

to  <  500k 

500k 

to  <  1m 

1  r.i 

to  <  10m 

1  On 

and  Greater 

Negotiated  Competitive  Supoly 

25k 

to  <  100k 

100;^ 

to  <  500k 

500k 

to  <  1m 

1m 

to  <  10m 

10m 

and  Greater 

Negotiated  Con.peti tive  Service 

Contract  Admin  Retained 

25k 

to  <  100k 

100k 

to  <  500k 

50  0k 

to  <  1m 

li.i 

to  <  10m 

10m 

ana  Greater 

STAK'DA 

RD 

PRODUCTIVE 

i-^Ai;K0U 
13 

RS 

UI.IT 

\iEIGHTS 

nc  ies 

1 

39 

13 

1 

26 

2 

39 

3 

143 

11 

143 

11 

182 

14 

182 

14 

ly 

39 

52 

117 
182 
182 

3 
4 

Q 

14 
14 

Negotiated  Sole  Source/8A/Nonprof i t 
Educational/Utilities 
25k  to  <  100k 
100k  to  <  500k 
50  0k  to  <  1m 
1m  to  <  10m 
10m  and  Greater 


52 
156 
156 
195 
195 


52 
156 
156 
195 
195 


4 
12 
12 
15 
15 


4 
12 
12 
15 
15 


Note:   Productive  units  weights  were  calculatea  by  dividing 
delivery  order  manhours  into  the  manhours  for  each 
contract  type. 


The  calculation  of  the  small  purchase  rate  is  based 
simply  on  the  number*  of  units  completed  less  Foreign  iiilitary 
Sales  (Fi'lS)  actions.   Also,  there  is  a  procedur'e  for  adding 
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units  oased  en  a  s  i;;;,nif  icant  increase  in  vjorkload,  but  since 
this  is  not  pertinent  here  it  will  not  be  discussed  furuher. 

Using  the  pr^evious  guidelines,  each  NAVSUP  activity 
figures  a  rate  based  on  past  performance.   This  rate  is  then 
applied  to  the  projected  v;orkload  of  the  activity.   At  the 
end  of  eacn  fiscal  quarter,  the  estimated  and  actual  outputs 
and  rates  are  compared.   If  the  actual  amounts  significantly 
exceed  or    fall  short  of  the  estimates,  funds  are  either  paid 
out  to  the  activity  or  paid  back  to  liAVSU?  oased  on  Table  2 
[Ref  2] . 

From  tne  previous  information,  it  is  easy  to  see  that  the 
PUR  system  causes  the  I.'FCS  managers  to  have  significant 
interest  in  the  number  of  contracts/purchases  produced,  wnile 
showing  little  to  no  concern  over  the  quality  of  the  output. 
In  some  of  the  other  fields  covered  by  PUR  such  as  material 
accounting,  fund  resource  accounting,  and  disbursing,  quality 
standards  have  been  placed  in  the  system  that  attempt  to 
prevent  the  quality  of  the  product  or  service  from  declining 
as  a  result  of  this  ne\-i   emphasis  on  quantity.   Currently, 
liowever,  there  is  no  system  in  place  that  does  this  for 
procurement.   This  thesis  will  attempt  to  address  this 
dilemma . 

In  all  areas  covered  by  PiJR,  there  is  a  general  and 
administrative  (Gi^A)  pool  which  covers  such  items  as 
training,  administrative  support,  transportation  and 
utilities.   In  the  acquisition  aretia,  it  also  covers 
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Procureiaent  Mana,2,ernen  i:  Review.   This  GaA  pool  is  not  basea  on 
a  rate  per  productive  unit,  but  is  expected  to  vary  in 
relation  to  uhe  activity's  v/orkicad.   The  resources  for  Gc:A 
are  prcvidec  as  an  allocation  to  tne  aci:ivii:y  in  zYie 
financial  oper£i:ing  plan  and  are  divided  among  the  GiA  cost 
centers  by  the  activity. 

B.   QUALITY 

1  .   Definin'3  Quality 

Uebster  defines  quality  as  "a  degree  of  excellence" 
[Ref  3: p.  963].   The  problem  that  exists  with  this 
definition,  however,  is  to  define  excellence.   Attempting  to 
follow  such  a  chain  would  not  put  us  any  nearer  our  goal. 
Probably  the  best  definition  found  for  quality  in  researching 
this  subject  was  "I  know  it  when  I  see  it"  [Ref  ^].   Tnough 
this  does  not  offer  any  specific  guidelines  for  measuring 
quality,  it  does  highlight  one  of  tne  key  aspects  of  quaJity: 

There  is  no  one  measure  of  quaiitv  that  applies  to 
all  circumstances . 

This  does  not  mean  that  quality  is  not  measurable  nor 
does  it  mean  that  quality  cannot  be  defined  for  a  specific 
product  or  service.   It  does  mean  however,  that  any  measure 
chosen  must  be  the  correct  one  for  achieving  the  desired 
results.   Also,  any  definition  given  to  quality  for  a 
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particular  procuct  or  service  should  be  flexible  enough  lo 
adapt  to  changes  in  the  product  or  service  as  well  as  changes 
in  tne  custcn:ers  neeas. 

V/ith  these  considerations  in  mind,  a  definition  for  a 
quality  procurement  can  be  provided  that  v;ill  be  usee  as  a 
guide  for  this  thesis.   The  Arrred  Services  Pricing  Manual 
states  tnat   "The  oojective  of  procurement  is  to  secure 
needed  supplies  and  services  from  responsible  sources  at  fair 
and  reasonable  prices  calculated  to  result  in  the  lowest 
ultimate  overall  cost  to  the  Government"  [Ref  5 :  P .  2-1].   The 
Federal  Acquisition  Regulations  and  supplements  tnereto 
further  require  tnat  the  delivery  schedule  be  adherea  to, 
that  the  specifications  be  met,  and  that  the  rules  and 
regulations  governing  the  procurement  be  followed  in 
accomplishing  the  task.   Therefore,  for  the  purposes  of  this 
thesis  the  best  definition  of  a  quality  procurement  3ee;as  to 
b e  one  that  provides  to  the  customer,  the  desired  item  or 
service  within  the  time  required  at  a  fair  and  reasonable 
price  that  is  in  the  best  overall  interests  of  the  Government 
and  that  is  in  compliance  with  the  rules  and  re^;ulations  that 
govern  such  a  procurement. 

2 .   The  Need  for  Quality 

As  difficult  as  quality  is  to  define,  achieving  it  is 
even  more  formidable.   The  need  for  it  though  cannot  be 
questioned.   The  number  of  practicing  quality  experts  today 
is  sraall  coir.pared  to  the  demand  for  their  services,  out  tneir 
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numbers  are  grovving.   Modern  companies  nave  recognized  that 
in  order  to  be  successful,  quality  products  or  services  must 
be  the  company  standard  [Ref  6:p.  30].   The  U.S.  Governn-ent 
is  also  taking,  notice  of  tne  necessity  for  quality.   The 
recently  published  findings  of  the  President's  Blue  Ribbon 
Commission  on  Defense  I-lanagement  (The  Packard  Commission ) 
highlighted  the  need  for  increasing  quality  in  one  cf  its 
recommendations  under  the  area  of  defense  procurement. 
Recommendation  F  of  this  report  stated  that  "Federal  law  and 
DoD  regulations  should  provide  for  substantially  increased 
use  of  commercial-style  competition,  eLiphasiz ing  quality  and 
established  performance  as  well  as  price"  [Ref  7:p.  62]. 

V/hy  the  em.phasis  on  quality?   There  are  two  basic 
reasons  why  quality  is  a  good  idea.   First,  in  the  commercial 
sector,  if  the  quality  is  low  the  product  won't  sell.   Every 
year  customers  get  smarter  and  the  demands  for  a  quality 
product  that  they  place  on  suppliers  increase.   Unless  the 
supplier  can  satisfy  the  consumer,  the  consumer  will  go 
elsewhere  for  his/her  needs.   This  reality  caught  American 
carmakers  by  surprise,  but  since  they've  realized  it,  quality 
has  becomie  the  primary  concern.   The  second  reason  for  being 
interested  in  quality  is  that  quality  costs  less  [Ref  8:p. 
6].   If  a  job  is  done  correctly  the  first  time,  there  is  no 
need  to  bear  the  expense  of  correcting  mistakes.   Also,  the 
time  used  to  do  the  work  the  first  time  will  not  have  been 
wasted.   In  many  cases  the  cost  of  redoing  the  work  can  be 
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greater  than  the  cost  of  aoing  it  correctly  tne  first  time. 
Modern  businessmen  h£ve  recognized  these  facts  and  are  taking 
action  to  improve  tneir  quality. 
3 .   Achieving  Quality 

There  are  many  programs  for  achieving  quality.   VJ. 
Edv/ards  Den.ing  is  recognized  by  miany  as  the  leader  in  the 
quality  field  and  his  book  Quality,  Productivity,  and 
Competitive  Position  is  the  basis  for  much  of  this  thesis. 
There  are,  hov;ever,  miany  other  recognized  quality  experts 
practicing  today.   Joseph  M.  Juran  and  P.  3.  "Pnil"  Crosby 
are  also  among  the  many  well-known,  practicing  quality 
specialists  today.   Some  of  their  work,  as  well  as  that  of 
others,  was  a  part  cf  tne  research  effort  in  compiling  this 
thesis.   Hopefully,  by  gleaning  the  parts  of  the  current  work 
in  the  quality  field  that  seem  to  have  the  greatest 
correlation  to  the  field  of  contracting,  this  thesis  can 
present  an  overall  plan  for  achieving  quality  in  contracting,. 
Interested  readers  should  consult  the  bibliography  section  of 
this  thesis  for  further  reading  on  the  subject  of  quality. 

A  key  point  that  is  noted  over  and  over  in  the 
literature  on  quality  and  that  should  be  emphasized  from  tne 
beginning  is  that  quality  cannot  be  obtained  instantly. 
Neither  does  the  quest  for  improving  quality  ever  end. 
Current  Ford  Motor  Corporation  comiTrercials  advertise  that 


18 


quality  was  made  "job  one"  in  1976.  Ten  years  later,  this  is 
still  their  primary  concern  and  the  dedication  tov/ards  it  has 
not  lessened. 

4 .   Deming's  Fourteen  Points 

The  follovjing  discussion  v;ill  focus  on  the  work  of  VJ . 
Edwards  Deming  and  his  fourteen  points  that  are  the  basis  for 
his  program  to  achieve  quality.   Der.iing  began  as  a 
statistician  but  expanded  into  the  quality  world.   Over 
thirty  years  ago  Deiiiing  went  to  Japan  and  presented  his  ideas 
on  quality.   The  success  of  his  program  in  Japan  led  to  th^e 
current  regard  for  him  in  this  country.   The  commercial 
success  of  Japanese  products  in  this  country  led  uo  U.  S. 
businesses*  concern  for  quality. 

The  fourteen  points  proposed  by  Deming  to  obtain 
quality  in  a  program  are  not  a  cure-all  and  may  not  even 
apply  in  every  circumstance.   They  are  however,  a  positive 
place  to  begin  a  quest  for  quality  and  are  presented  here    i.n 
that  respect.   Il  should  also  be  noted  that  Deming  wrcte  in 
the  context  of  presenting  a  program  for  commercial, 
production  based  organizations  thus  some  of  his  points  will 
need  adaptation  [Ref  8: pp.  17-^9], 

Point  1  -  Create  constancy  of  purpose  for  improvement  of 
product  and  service. 

This  is  one  of  the  most  important  and  most  difficult 
conditions  to  obtain  in  achieving  quality.   Saying  you  want 
quality  is  not  enough.   Everyone  involved  in  the  process  must 
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be  dedicated  to  tine  concept  of  quality.   Slogans  such  as  Zero 
Defects  and  "Quality  is  Job  One"  are  useless  unless  everyone 
from  top  management  do'wn  actually  believes  quality  is' of 
prime  in.portance  and  carries  out  their  duties  in  consonance 
with  tnis  goal.   The  question  on  everyone's  mind  should  be, 
"VJhat  can  be  done  to  improve  the  quality  of  the  product?" 
The  answer  may  lie  in  m.ore  training,  better  equipment,  labor 
saving  proceaures  or  any  number  of  other  ideas. 
Point  2  -  Adopt  the  new  philosophy . 

Put  another  way,  this  point  is  "don't  accept 
mistakes".   Just  because  something  was  "good  enough"  in  the 
past,  it  isn't  necessarily  "good  enough"  now.   Every  n.istaKe 
made  costs  time  and  nioney.   If  an  organization  is  going  to 
achieve  quality,  it  must  seek  to  eliminate  all  mistakes. 
Point  3  -  Cease  dependence  on  mass  inspection. 

There  are  two  concepts  here.      First,  if  the  person 
first  making  the  item  (writing  the  contract)  knows  it  will  be 
reviewed,  and  probably  changed,  they  are  less  likely  to  be 
concerned  with  getting  it  right  the  first  time.   In  addition, 
it  costs  mioney  to  inspect.   If  every  item  is  inspected,  wnen 
a  statistical  sample  could  produce  the  same  result,  money  and 
or  manpower  is  being  wasted. 

Point  M  -  End  the  practice  of  awar'ding  business  on  price  taz 
alone . 

This  is  a  key  concept  of  Deming's  and  is  one  that  is 
echoed  to  a  degree  in  the  Packard  Coiiiniission  recoiiUr.endat ion 
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noted  earlier.   In  the  context  of  this  thesis,  however,  it 
does  not  apply  directly.   The  concept  of  doin^,  anytning  on 
one  basis  only  does  apply  however.   As  long  as  the  PUR  system 
considers  nuniber  of  documents  conipieted  to  be  the  only 
controlling  factor,  quality  of  contracts  in  the  i-iFCS  will 
suffer.   If  en  the  other  hand,  quality  is  included  as  a  xey 
(Deraing  would  say  -  the  key)  concept,  then  quality  contracts 
may  be  possible. 

Point  5  -  Constantly  and  forever  improve  the  system  of 
production  and  service. 

This  is  probably  Deming's  key  point  that  applies  to 
this  thesis.   The  secret  here  is  to  improve  the  system  to 
make  the  job  being  done  easier  and  at  the  same  time  maintain 
or  improve  the  quality  of  the  output.   Many  of  the 
improvements  can  come  from  the  workers,  if  management  listens 
to  and  acts  on  their  recomuiendations .   But,  the  greatest 
improvements  must  com.e  from  managemient.   This  is  true  not 
only  to  show  tne  workers  that  m.anagement  is  committed  to 
quality,  but  also  because  management  is  in  the  best  position 
to  see  the  overall  effect  of  changes  on  the  entire  operation. 
Point  6  -  Institute  modern  methods  of  trainin-;  on  the  job . 

This  point  goes  hand-in-hand  with  the  previous  one. 
As  important  as  training  is  to  the  proper  execution  of  the 
task,  it  is  amazing  how  often  it  is  put  far  behind 
accomplishing  the  job.   This  is  even  miore  surprising  when,  as 
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pointed  out  earlier,  it  costs  ri.ore  in  time  and  effor't  to  fix 
a  poorly  done  job  than  to  do  the  job  correctly  trie  first 
time  . 
Point  7  -  Institute  modern  :nethcas  of  suoervislon . 

This  tnesis  is  on  quality  so  it  will  not  attempt  to 
cover  the  area  of  supervision.   It  snould  be  noted  however, 
that  poor  supervisors  or  managers  at  any  level  are    prcoabiy 
the  greatest  obstacles  to  achieving  quality.  (See  point  10.) 
Point  8  -  Drive  out  fear. 

J.  i-i .  Juran  differs  from  Deming  in  that  he  believes 
that  fear  is  good  in  that  it  can  get  the  most  out  of 
employees.   Thougn  this  may  be  true,  anotner  problem  is 
created  by  fear.   Employees  that  are  afraid  are  unlikely  to 
come  forth  with  new  ideas  and  in  extreme  cases  may  even 
vvithhold  information  that  is  crucial  to  the  success  of  the 
company.   If  "productivity  at  all  costs"  is  the  m.essage  the 
employee  hears  and  an  environm.ent  of  fear  is  present,  no 
improvements  are  going  to  be  forthcoming  concerning  quality. 
In  addition,  poorly  trained  personnel,  rather  than  bringing 
attention  to  themselves  by  asking  questions,  are  going  to 
continue  to  produce  tne  sanie  poor  quality  goods  over  and 
over.   Fear  is  related  to  the  previous  point  in  tnai,  as  the 
quality  of  management  improves  and  employee  fai"ch  in 
management  increases,  the  aaiount  of  fear  will  likely  decline. 
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Point  9  -  Break  dovjn  carriers  between  staff  areas. 

One  of  the  greatest  impediments  to  any  organization 
in  achieving  its  goal,  ce  it  quality  or  anything  else,  is 
competition  betvveen  sub-or'ganizaticns .   If  goals  are  not 
established  intelligently  by  management,  in  the  interest  of 
optimizing  their  own  circumstances,  lov;er  level  managei's  Liay 
take  action  that  supports  tneir  individual  area  at  the 
expense  of  the  entire  organization.   For  example,  if  the 
guidance  given  to  production  is  to  produce  thie  maxim.ura 
quantity  possible,  concern  over  quality  will  decline  ana  the 
amount  of  rework  and  overall  costs  will  probably  increase. 
Point  10  -  Eliminate  numerical  goals,  posters  and  slogans  for 
the   work  force  which  ask  for  new  levels  of  productivity 
without  providing  methods  for  achieving  these  new  levels . 

This  point  at  first  glance  seems  to  run  contrary  to 
commonly  accepted  ideas  for  improving  quality.   If  people 
know  how  they  stand  and  where  they  need  to  be,  then  they 
can't  help  but  get  better,  right?   Virong.   Most  people  try  to 
do  the  best  job  they  can  given  the  tools  at  hand.   A  chart 
that  tells  them  where  they  are  in  relation  to  where  they 
should  be  without  telling  them  how  to  get  there  will  probably 
result  in  decreased  morale  rather  than  increased  output. 
However,  a  chart  that  gives  not  only  the  status  to  date,  but 
also  lists  efforts  being  undertaken  by  management  to  in:prove 
the  system  can  ooost  morale. 
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Point  11  -  Eliminate  work  standards  and  numerical  quotas. 

If  the  a;T;ount  of  output  is  the  standard  by  wriich  Lhe 
employee  will  be  graded  (or  paid)  then  that  will  be  his/her 
chief  concern.   If,  on  the  other  hand,  tne  err.ployee  is 
allov>,'ed  to  produce  at  the  pace  that  allows  nim/ner  lo  produce 
the  o.uality  of  product  desired  then  tnat  will  become  the 
primary  concern. 
Point  12  -  Remove  barriers  that  hinder  the  hourlv  worker . 

There  are  many  of  tnese  barriers.   According  zo 
Deming,  "...they  exist  in  almost  every  plant,  factory, 
cou.pany,  department  store  and  government  office,  in  the 
United  States  today"  [Ref  8:p.  451.   Some  of  tne  barriers 
are:  the  lack  of  a  clear  definition  of  what  is  wanted, 
inspection  standards  that  are  interpreted  differently  by  eacn 
inspector,  poor  quality  or  incorrect  niaterial  to  uork   w]"Gh, 
and  finally,  incon.ipetent  management.   Removing  these  barriers 
is  no  small  task  and  it  is  one  of  the  reasons  that  the  quest 
for  quality  never  ends. 

Point  13  -  Institute  a  vigorous  program  of  education  and 
training. 

In  order  to  obtain  quality  it  is  necessary  to  train 
people  not  only  on  hcv;  to  do  their  job  better,  but  also  on 
how  to  produce  a  quality  product.   Inspectors  must  be  trained 
on  quality  standards,  employees  m.ust  be  kept  up-to-date  with 
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new  metnoGS  and  procedures,  and  management  must  be  familiar 
Vi/ith  statistical  methods  to  see  where  problerris  are  and  how  to 
best  resolve  them. 

Point  1U  -  Create  a  structure  in  too  management  that  will 
push  every  day  on  the  above  1^  points. 

Though  this  seems  to  be  just  a  reemphasis  of  the 
previous  points,  it  is  much  more.   The  key  points  are  that  it 
must  be  top  management  and  that  it  must  be  pushed  every  day. 
V.'ithout  the  total  support  and  partj.cipation  by  top  mana£,ei:ient 
any  quality  program  is  doomed  to  failure.   Just  as  important 
is  cofjstant  emphasis  on  quality.   Everyone  must  be  n.otivatsd 
at  all  times  to  produce  a  quality  product. 
5 .   Statistical  Methods 

As  a  statistician,  Deming's  entire  program  is  based 
upon  statistical  analysis  of  data  to  identify  both  pr'oblems 
with  and  methods  for  obtaining  quality.   Changes  intended  to 
improve  the  system  should  not  be  made  blindly.   The  basis  for 
any  decision  should  be  based  on  statistical  evidence.   Don't 
make  a  change  without  having  a  method  of  measuring  the  effect 
of  the  change.   This  thesis  will  not  attempt  to  provide  a 
precise  statistical  model  for  use  in  measuring  progress 
towards  quality.   There  are  many  different  models  available 
[Ref  9]  cind  more  are  developed  every  day.   The  key  is  to  pick 
a  method  that  measures  increases  or  decreases  in  quality  and 
use  that  model  consistently.   More  will  be  said  on  this 
subject  in  the  final  chapter. 
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6 .   Synopsis  of  Findings 

Deming's  book  ana  otners  on  the  suoject  offer  v.'ell 
defined  and  step-by-step  procedures  for  obtaining  quality. 
None  of  what  has  been  'written,  however,  offers  a  progran.  for 
obtaining  quality  in  tne  procurement  arena.   One  study  was 
Qiscovered  that  investigated  this  field  and  it  will  be 
reviewed  in  the  following  chapter.   It  is  important  to  note 
here  though  that  some  aspects  of  quality  seem  to  oe 
predominant  in  almost  all  writings  on  the  subject.   They  will 
be  restated  here  for  the  manager  interested  in  taci<lin^  the 
quality  program  that  might  not  nave  the  time  or  tne 
inclination  for  furtner  research  in  the  area.   Tnese 
principles  are  the  basis  for  tne  findings  of  this  tnesis  and 
should  be  foreniost  in  the  minds  of  tnose  concernea  with 
quality  in  procurement.' 

Principle  1  -  Measures  of  quality  vary  accoroinu,    to  the 
product  and  the  needs  of  the  customers. 

There  can  be  no  central  measure  of  quality  that 
applies  in  all  circumstances.   Even  if  the  product  is 
constant,  the  customers'  needs  may  vary  based  on  time  and 
location.   Any  organization  seeking  to  improve  its  quality 
must  recognize  this  and  ensure  tnat  quality  measures  are 
flexible  enough  to  adapt  to  changes  in  the  product  anc:  its 
customers. 


'   The  basis  for  most  of  the  principles  listed  here  are 
drawn  from  the  works  for  VJ .  Edwards  Deming  and  John  Guaspari. 
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Principle  2  -  I ui p r o v i n ^^  quality  is  a  1  o n f, - 1 e r m ^  n e v e r - e r. d i n r. 
process . 

There  is  no  quick  fix  tc  quality.   It  is  not  possible 
to  wave  a  hand  and  expect  quality  to  appear.   Only  over  tir.ie 
can  gains  in  quality  be  measured  to  verify  that  actions  taken 
were  the  correct  ones.   There  is  always  room  for  improverr.ent . 
Any  organiza bion  tnat  decices  it  is  satisfied  with  the 
present  level  of  quality  will  newer    achieve  real  quality. 
Also,  as  noted  in  principle  number  one,  quality  is  constantly 
changing.   V/hat  is  considered  a  quality  product  today,  may 
only  be  adequate  by  totnorrow's  standards. 
Principle  3  -  Dedication  to  quality  must  be  total. 

The  emphasis  on  quality  cannot  be  diluted  by  other 
factors.   It  is  not  possible  to  achieve  quality  and  quota,  or 
quality  and  market  share,  or  quality  and  low  cost.   V/hat  is 
likely  though  is  that  dedication  to  quality  will  result  in 
reachiing  quota,  gaining  market  sha.re,  and  possibly  even 
maintaining  low  cost.   VJork  done  right  the  first  time  does 
not  require  rework  or  mass  inspection.   Tr.is  allows  workers 
to  increase  output.   Quality  products  sell.   Today's 
consumers  are  willing  to  pay  for  quality  so  a  company  with  a 
quality  product  is  likely  to  control  the  market.   Finally, 
quality  does  cost  less.   Rev;ork,  waste,  and  loss  of  customers 
all  cost  money.   Quality  products  minimize  all  of  these  and 
make  for  a  better  product  at  less  cost.   Principle  two  should 
be  remem.bered  here  though.   Quality  improvements  will  not 
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happen  overnight  and  obtaining  then  will  not  be  cheap.   Kew 
attitudes  must  be  learned  and  training  riiust  be  given.   These 
cost  in  terms  of  money  and  manpower.   The  organization  niust 
be  willing  to  pay  this  price  foi'  increased  quality  in  tne 
future  . 

Principle  4  -  Irnorcving  the  workers  is  not  the  answer, 
improving  the  system  Is. 

Most  people  already  work  as  liard  as  tney  can. 
Telling  them  that  they  need  to  work  narder  is  net  the 
solution  to  quality  and  will  probaoly  nave  just  the  opposite 
effect.   Once  a  thorough,  dynamic  training  program  is  in 
place  to  ensure  that  workers  are  as  completely  trained  as 
possible,  improvemenLs  in  quality  must  com.e  from  iiiiprovements 
in  the  system.   This  is  management's  responsibility.   Its 
constant  concern  should  be  to  find  ways  to  improve  the  output 
of  the  system  by  finaing  ways  to  iiPiprcve  it.   Hew  technology 
that  can  increase  employe.e  output  while  improving  Lhe 
produce,  new  methods  of  statistical  checking  to  ensure  thau 
changes  are,  in  fact,  an  improvem.ent ,  and  listening  to 
workers'  suggestions  for  improving  the  product  are  all 
examples  of  how  m.anager.ient  can  accomplish  this  task.   Tne  key 
is  that  management  should  newer    be  satisfied  with  its 
efforts.   The  quest  for  quality  improvements  shcula  be 
constantandnever-ending. 
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Principle  5  -  Quality  cannot  be  achieved  through  mass 
inspection. 

The  fifth  and  final  principle  is  a  warning  for 
managers  first  attempting  to  in.prove  their  product  quality. 
This  tnesis  will  attempt  to  offer  measures  for  procuremenT: 
quality  in  later  cnapters,  however,  these  measures  are  only 
that,  a  measure.   By  inspection,  they  can  hopefully  provide 
som^e  indication  of  tne  quality  of  the  product.   They  caiinot, 
hcv;ever,  improve  the  product.   VJhat  they  offer  is  a  gau^e  of 
how  quality  is  progressing.   The  job  still  remains  to 
determine  what  is  causing  the  quality  problems  and  correct 
them.   Has  training  been  inadequate  in  a  particular  area? 
Are  time  or  quantity  demands  being  placed  on  workers  thai: 
override  the  concern  for  quality?   Does  the  original  input  to 
the  v;orker  require  so  much  rework  that  most  of  his/her  tir.je 
is  spent  in  its  correction  racher  than  in  the  accomplishment 
of  the  original  task?   These  are  the  types  of  questions  that 
management  must  ask  to  improve  the  quality.        However, 
remember  principle  tv;o .   If  inspections  reveal  that  quality 
has  been  achieved,  then  there  is  probably  something  wrong. 
Is  the  quality  of  the  inspection  as  high  as  it  could  oe?   Are 
the  current  measures  of  quality  still  adequate?   The  quality 
job  is  a  constant  job  that  is  continually  changing.   Quality 
can  never  be  achieved  entirely.   It  can  only  be  strived  for. 
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VJhen    that    has    become    the    cor.imon    goal    of   workers    and 
raanagemen t    tnen    the    organization    is    vjell    on    its    way    to 
success  . 

C.       SUr.MARY 

The  purpose  of  this  chapter  is  to  prcviae  tne  reader  wiLh 
a  basic  introduction  to  quality  and  sone  key  elerr.ents  that 
should  be  considered  in  the  development  of  a  quality  progran; 
for  an  activity.   This  information  should  provide  a  frai.ieworx 
for  the  reader  which  will  help  in  the  presentation  of  current 
practices  and  past  studies  that  are  presented  in  the 
following  chapter. 
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III.   RESEARCH  FinpINC-S  AND  ANALYSIS 

A.   PREVIOUS  STUDIES 

The  study  of  quality  in  this  country  has  been  lirnited 
until  very  recently.   Though  there  have  been  many 
practitioners  in  tne  field,  there  has  been  little  research. 
Only  in  tne  past  ten  years  cr  so  has  the  business  coMi.iurii ty 
taken  a  real  interest  in  c^^uality. 

The  specific  area  of  quality  in  procurement  has  received 

even  less  attention.   Quality  of  the  products  or  services 

provided  by  a  contractor  has  been    thoroughly  studied  and 

there  is  a  great  amount  of  literature  concerning  this 

particular  aspect  of  quality.   The  specific  field  of  contract 

quality  however,  has  generated  almost  no  studies.   The  study 

of  productivity  has  generated  a  great  deal  of  literature,  and 

a  review  was  conducted  to  attempt  to  glean  quality  related 

material  from  the  general  area  of  productivity.   A  report  on 

productivity  conducted  at  the  U.  S.  Air  Force  Academy  in  June 

1974  [Ref  10:p.  74]  made  the  following  statement: 

Finally,  considerations  of  qual i  tv  must  be  taken  into 
account.   In  using  productivity  measures  to  assess  the 
effect  of  policy  changes,  the  manager  must  assure  himself 
that  an  increase  in  productivity  is  not  achieved  at  the 
expense  of  quality.   Thus  quality  control  and  management 
are  necessary  adjuncts  to  any  meaningful  effort  to  measure 
and  enhance  productivity. 

In  January  of  1975  another  study  was  initiated  at  the  Air 

Force  Academy.   This  study  was  a  fcllow-on  to  the  one 
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conducted  by  LTC  Austin,  et  al.   Its  charter  v;as  "tc  defire  a 
quality  procurement  action  and  to  identify  factors  v;nich 
could  be  used  to  measure  the  overall  quality  cf  Air  Force 
procurement  actions"  [Ref  1 1 : p .  2]. 

As  the  single  study  found  in  a  reviev;  of  the  literature 
concerning  contracting  quality  and  thierefore  its  particular 
significance  to  this  thesis,  a  review  of  the  research  and 
findings  of  the  Air  For'ce  study  will  be  presented  in  the 
following  pages. 

1 .   Background  of  the  Study 

The  genesis  for  the  study  has  already  been  described. 
It  should  also  be  noted  that  none  of  the  members  of  the 
research  team  had  any  previous  contracting  background.   The 
first  task  of  the  study  was  to  define  a  quality  procurement 
action.   The  following  definition  was  decided  upon:   "A 
quality  procurement  action  is  one  which  provides  to  the 
customer  the  required  i  tem./serv  ice  at  the  correct  time  and  at 
a  fair  price"  [Ref  11:p.  31.   The  study  was  limited  to  Air 
Force  procurements  but  also  noted  there  was  a  vast  range  cf 
procurements  within  the  Air  Force.   Recognizing  that  defining 
quality  measures  for  such  a  vast  array  of  procurements  would 
be  difficult,  the  study  was  limited  to  procuremients  between 
$100,000  and  $1,000,000.   At  the  time  of  this  study  (1975) 
only  one  procurement  office  in  the  Air  Force  had  any  quality 
control  system.   The  system  was  located  at  the  Sacramento  Air 
Logistics  Center  and  concentrated  on  file  integrity  as  the 
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controlling  factor  in  contract  quality.   The  Air  Force 
Academy  researchers  did  not  feel  that  file  integrity  alone 
satisfied  their  definition  of  quality  and  strived  for  more 
"macro"  measures  of  quality.   Currently,  all  Air  Force  bases 
have  some  form  of  procurement  quality  control.   General 
aspects  of  the  system  currently  in  place  in  the  Air  Force 
will  be  discussed  in  the  latter  part  of  this  chapter. 

2 .  Conduct  of  the  Study 

The  study  opted  to  use  surveys  for  conducting  the 
bulk  of  the  research  on  qua],  ity  measures.   There  vv/ere  two 
surveys  used  in  the  review.   The  first  survey,  which  was 
intended  to  identify  factors  which  influenced  quality  in  a 
procurement,  used  open-ended  questions.   A  duplicate  of  this 
survey  is  included  in  Appendix  A  of  this  thesis.   It  was 
intended  to  get  responses  from  practitioners  in  the  field  as 
to  what  factors  constituted  a  quality  procurement.   The 
second  survey  was  designed  to  rank  order  the  responses  from 
the  first  survey  and  was  sent  to  a  different  group  of  people 
(See  Appendix  B)  .   Both  surveys  were  sent  to  over  100  people 
and  responses  were  received  from  49.5  (survey  1)  and  75.5 
(survey  2)  per  cent  of  those  surveyed. 

3 .  Results  of  the  Survey 

The  results  of  the  first  survey  provided  the 
information  used  to  conduct  the  second  survey.   The  results 
of  the  second  survey  are  presented  here  [Ref  11 :p.  12-32]. 
It  should  be  remembered  throughout  the  review  of  this  study 
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that  the  only  factors  reviev;ecl  for  potential  influence  on 
quality  were  those  that  were  highlighted  during  tne  first 
survey.   Otner  procurement  professionals  nay  note  facuors  not 
covered  in  the  survey  v;hich  might  be  considered  to  have  a 
greater  or  lesser  impact  on  procurement  quality.   The  intent 
of  the  review  here  is  to  highlight  possible  areas  of  concern 
for  those  interested  in  improving  procurement  quality. 
Question  1:  Procurement  Planning  Phase 

The  factor  with  tne  most  influence  on  quality  in  this 
phase  of  the  procurement  process  was  considered  to  be  a  clear 
description  of  the  needea  item  or  service.   Second  was 
maintaining  open  lines  of  communication  between  the 
procurement  team  and  the  customer.   Though  it  was  not 
highlighted  by  the  USAF  study,  it  should  be  noted  iiere  that 
good  communication  between  the  customer  and  the  user  can 
greatly  in^prove  the  chances  of  receiving  a  well-defined 
requirement.   VJhat  was  highlighted  by  the  study  was  that  good 
communication  between  the  buyer  and  the  user  was  a  key 
influencing  factor  for  quality  throughout  the  second  survey. 
This  reaffirmed  comments  on  the  first  survey  which  indicated 
that  many  of  the  problems  that  arose  during  a  procurement 
were  directly  related  to  a  breakdown  in  cor.miunica tion  between 
the  parties  to  the  contract. 
Question  2:  Formally  Advertised  Procurement 

A  clear  and  unambiguous  invitation  for  bid  was  the 
most  important  factor  in  the  sealed  bid  arena.   Most  of  tne 
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other  initial  survey  responses  v;ere  grouped  in  the  middle  of 
the  scale.   Five  of  the  surveys  in  this  area  contained  write- 
in  factors  that  were  considered  of  high  iriiportance  for 
quality.  These  factors  were: 

a.  Allow  adequate  time  for  delivery  or  perfornance. 

b.  Good  contract  administration  following  award. 

c.  Conduct  IFB  process  according  to  the  law, 

d.  Knovvledge  of  bid  opening  procedures. 
Question  3:  Negotiated  Procurement 

As  might  be  expected,  the  first  choice  in  this  area 
was  a  clear  and  unambiguous  request  for  proposal.   The  next 
most  important  was  an  internal  prenegotiat ion  strategy 
conference.   There  wei-e  several  write-in  factor's  in  this  area 
as  well.   The  key  ones  were: 

a.  Careful  selection  of  source  selection  and  negotiation 
team . 

b.  Conduct  negotiations  according  to  appropriate 
regulations. 

c.  Accurate  specifications  and  adequate  procurement  lead 
time  . 

Question  ^:    Contract  Administration 

The    post-avjard    conference,    early    recognition    of 

contractor's  problems  and  open  lines  of  communication  all 

scored  high  in  their  influence  of  quality  in  the  contract 

administration  area.   As  the  study  noted,  each  of  these 

characterize  a  portion  of  the  communication  process  linking 

the  contractor,  the  administrative  contracting  officer  (ACQ) 

and  the  procurement  contracting  officer  (PCO). 
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Interestingly,  trie  factor  which  received  the  lowest  score  for 
this  question  was  audits  of  the  contractor.   There  were  four 
important  write-ins  for  'chis  question.   They  were: 

a.  Careful  selection  of  the  administration  team. 

b.  Timely  acceptance  and  paynient. 

c.  Knowledge  of  contractor's  overall  operating  systei:i. 

d.  Good  feedback  to  contractor's  top  management. 
Question  5:  General  Factors 

The  three  factors  that  shov-jed  the  greatest  influence 
on  improving  the  quality  of  a  procurement  were  open  lines  of 
communication,  a  well-documented  procurement  package,  and  a 
high  level  of  competition  for  government  contracts.   Based  on 
the  previous  responses  the  first  two  factors  were  expected. 
The  third  one,  an  increased  level  of  competition  is  however, 
somewhat  surprising.   It  should  be  remembered  that  this  study 
was  conducted  in  1975,  long  before  the  current  push  for 
competition.   Also,  the  respondents  to  the  questionnaire 
were,  for  the  most  part,  from  field  activities.   The 
recognition  of  the  beneficial  influence  of  competition 
between  potential  government  contractors  at  that  level  and  at 
that  tiiiie  is  significant.   There  were  four  factors  that  stood 
out  as  having  a  detrimental  effect  on  contract  quality.  They 
were  the  infusion  of  personnel  into  procurement  management 
positions  with  inadequate  procurement  experience,  contracting 
officers  assigned  too  many  contracts  to  handle  each 


effecLively,  use  of  purchase  price  alone  as  the  criterion  for 
contract  award,  and  failure  of  the  government  to  meet  one  or 
more  provisions  of  the  contract. 

Questions  6  through  9  dealt  specifically  with 
determinants  of  quality  in  contracting  personnel  vice  the 
quality  of  the  contract  itself.   Since  this  is  beyona  the 
scope  of  this  thesis,  they  will  not  be  reviewed  here. 
Question  10:  Measures  of  Quality 

Customer  satisfaction  was  the  overwhelming  favorite 
as  a  choice  for  an  effective  measure  of  quality. 
Contractor's  meeting  of  milestones  was  second  while  contract 
modifications  and  comparison  cf  cost  estimates  with  actual 
costs  were  a  distant  third  and  fourth,  respectively.   The 
responses  received  here  are  interesting  and  point  out  one  of 
the  flaws  with  the  survey.   Measures  cf  quality  are  effective 
only  if  they  can  be  measured  quantitatively.   The  survey  did 
not  ask  the  respondents  how  the  measure  they  selected  could 
be  used,  only  what  it  should  be.   The  problem  that 
immediately  confronts  a  contract  manager  seeking  to  improve 
quality,  is  how  can  customer  satisfaction  be  measured.   If  it 
can  be  measured,  is  that  an  accurate  measure?   VJas  the 
custom.er  satisfied  because  the  contracting  officer  broke  all 
the  rules  to  satisfy  the  commitment  or  was  the  PCO  able  to 
satisfy  the  customer  and  still  follow  all  the  regulatory 
requirements? 
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If  the  survey  had  included  a  requ  irenien::  for  aavisin^  nov;  the 
measures  might  be  impleraentec  tne  responses  n.ight  nave  been 
considerably  different. 

It  cannot  be  questioned  that  satisfying  the  customer 
should  be  of  utmost  consideration  in  any  enterprise, 
including  government  procurement.   It  is  much  more  difficult 
however,  to  reach  agreeiaent  on  what  customer  satisfaction 
entails.   Even  tougher  is  measuring  customer  satisfaction  in 
order  to  obtain  a  measure  of  quality  of  the  procuct, 
especially  in  government  procurement.   Tne  factors  judged 
lower  by  the  respondents  in  the  USAF  survey,  may  nave 
received  higher  scores  had  the  survey  required  respondents  to 
explain  how  the  measures  could  be  applied.   It  is  relatively 
easy  to  count  the  number  of  modifications  made  to  a  contract, 
to  correct  errors  m,ade  previously,  or  simply  improve  on  the 
original  product.   It  is  also  simple  to  verify  wnether  tne 
contractor  met  the  milestones  specified  in  tlie  contract  and 
compare  the  estin.ated  costs  with  actual  costs.   All  the  other 
choices  in  the  survey  provided  much  more  assessable  measures 
of  quality,  but  the  simple  and  equally  difficult  to  define, 
custoraer  satisfaction  was  chosen  by  a  majority  of  the 
respondents  because  it  is,  in  the  final  analysis,  probably 
the  most  universal  measure  of  quality.   Later  chapters  of 
this  thesis  will  review  the  measures  of  the  USAF  study  as 
well  as  others  in  an  attempt  to  present  a  system  for 
improving  contracting  quality. 


4 .   Conclusions  of  the  Study 

The  USAF  study  determined  that  quality  procurement 
actions  were  the  result  of  two  general  classes  of  factors. 
These  were  participatory  ana  environmental  factors.   The 
participatory  factors  were  those  that  involved  active 
participation  by  the  customer,  procurement  team,  and  the 
contractor  in  the  procurement  process.   They  included: 

a.  Establishment  of  a  clear  under- standin^i  by  all  parties 
of  the  item/service  to  be  procured. 

b.  Provision  for  adequate  procurement  lead  time. 

c.  Open  communications  among  all  the  parties  to  the 
procurement  during  the  planning,  contract  award,  and 
contraci:  administration  phase  of  the  acquisition 
process . 

d.  A  well-documented  procurement  package. 

The  environmental  factors  concerned  the  conditions  that  m^ay 
influence  the  manner  in  which  the  procurement  is  conducted 
and  included: 

a.  The  qualifications  of  the  members  of  the  procurement 
teami. 

b.  The  workload  of  the  procurement  team. 

The  USAF  study  also  r;;ade  one  Icey  recommendation  in 
its  conclusion.   This  recommendation  was  to  use  multiple 
regression  analysis  to  determine  the  significance  of  each  of 
the  quality  measures  discovered  in  the  study  to  determine 
their  effect  on  a  quality  procurem.ent .   This  was  the  only 
mention  made  of  applying  statistical  methods  to  deterraine 
quality  in  procurem.ent  that  vjas  discovered  in  the  research 
for  this  thesis.   Regrettably,  it  does  not  appear  that  tiie 
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reconiLiendaticn  was  followed  as,  altriou^h  there  are  quality 
ennancing  programs  in  the  Air  Force  procurement  world  today, 
there  is  no  program  in  place  to  use  statistical  methods  in 
the  improvernent  of  the  level  of  quality. 

B.   CURREirr  PRACTICES 

In  order  to  deterraine  the  current  status  of  quality 
prograriis  in  use  in  the  NFCS  today,  a  visit  was  m.ade  to  five 
of  the  procurement  offices  within  the  system.   Sever-al 
interviews  were  also  conducted  with  personnel  outside  the 
system,  including  two  with  personnel  actively  involved  witn 
procurement  quality  in  the  Air  Force.   The  following  is  a 
synopsis  of  findings  from  the  research  conducted. 

1  .   General  F].ndin-<s 

The  single  most  notable  finding  in  researching  the 
field  offices  within  the  TIFCS  was  the  great  variety  of 
differences  within  those  offices.   No  two  offices  were 
organized  in  the  samie  manner,  nor  did  any  two  offices  have 
the  same  mission  or  the  same  type  of  customers.   This 
dissimilarity  of  operations  should  be  foremost  in  the  mind  of 
anyone  attempting  to  iraplenjent  a  program  that  will  affect  the 
entire  IIFCS. 

The  second  fact  discovered  in  the  research  was  that 
despite  the  lack  of  a  requirement  to  do  so,  almost  every 
office  visited  had  some  type  of  quality  program  in  place. 
Sonie  were  very  rudimentary  while  others  were  nearly  as 
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complex  as  those  subniittea  by  quality  specialists,  but  the 
important  point  is  that  the  need  for  a  quality  control 
prog  r- a  in  of  some  sort  was  recognized  and  acted  upon  by  field 
personnel . 

2 .   Specific  Findings 

The  purpose  of  the  research  was  to  learn  the  status 
of  quality  programs  currently  in  place  in  the  field  as  well 
as  background  information  in  developing  quality  m.easures. 
Five  offices  within  the  NFCS  were  visited  during  the  course 
of  research.   These  offices  were  tne  Aviation  Supply  Office, 
Philadelphia,  the  Naval  Supply  Center,  Norfolk,  and  the  Navy 
Regional  Contracting  Centers  at  Philadelphia,  Long  Beach,  and 
V/ashington,  D.C, 

VJith  one  of  the  largest  procurement  operations  in  the 
Navy,  the  Aviation  Supply  Office  had,  as  might  be  expected, 
one  of  the  most  fully  developed  quality  programs.   A  regular 
review  was  conducted  each  month  of  randomly  chosen  purchase 
orders  and  contracts  to  deterrr.ine  their  quality,  and 
statistics  were  kept  on  the  findings  of  these  reviews  [Ref 
12].   The  entire  program  was  documented  in  an  instruction 
signed  by  the  chief  of  procurement.   The  reviewers  had  guides 
with  which  to  conduct  the  audit  of  the  contractual  documents 
(See  Appendix  C)  and  a  report  was  completed  every  month  on 
the  discrepancies  that  were  found. 

The  quality  of  contracts  at  ASO  was  measured  by  the 
number  of  discrepancies  found  during  the  reviev;  of  the 
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documents.   The  discrepancies  were  noted  as  to  seriousness 
(Cat  I  was  most  serious  and  Cat  III  was  least).   Also,  the 
number  of  files  with  discrepancies  was  compared  to  the  number 
of  f:'les  reviewed  to  obtain  a  percentage  of  folders  deficient 
(e.g.,  1  of  5  were  deficient  for  2Q%)  .       The  como:;.na  tion  cf 
folaers  deficient  and  category  of  discrepancy  combined  to 
give  a  discrepancy  level.   Category  I  discrepancies  received 
a  weight  of  10,  category  II  were  5  and  category  III  were  1. 
This  allowed  a  numerical  determination  of  the  discrepancy 
level  as  noted  in  Table  3. 

TABLF.  3  -  DISCREPANCY  LEVEL  DETERMII.ATIOIJ  AT  ASO 


FOLDERS     FOLDERS 
REVIEVJED   DEFICIEK' 


PERCENT 
DEFICIEKT 

DISCREPANCY 
BY  GROUP 

I   II   III 

33 

1 

0    2 

50 

0 

1    1 

67 

1 

0    1 

DISCREPANCY 
LEVEL 

4.00 

3.00 

3.70 


There  were  only  a  few  problems  with  the  quality 
system.   One  of  the  problems  was  that  the  size  of  the  review 
staff  was  not  in  proportion  to  the  number  of  purchase  orders 
and  contracts  completed  each  year  [Ref  131.   Also,  tne  two 
people  that  were  assigned  to  the  task  had  other  duties 
besides  checking  the  quality  of  contract  documents.   Two 
problems  with  the  overall  quality  program  are  highlighted  by 
these  facts.   First,  there  was  not  an  overall  commitHient  to 
quality.   Personnel  involved  in  the  review  of  quality  were 
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assigned  other  tasks  that  tney  considered  to  be  as  iraportant 

or  r.iore  important  than  their  duties  concerning  quality 

improvements.   That  this  condition  was  allowed  to  continue 

suggests  that  top  management  wasn't  as  sLrongly  behind  the 

quality  push  as  it  may  have  been  in  order  to  insure  the 

success  of  the  program. 

Another  problem  with  the  system  was  the  type  of 

reports  provided  (See  Appendix  D).   The  small  purchase 

reports  describe  the  discrepancies  noted  under  a  general 

heading  in  groups  (I,  II,  or  III  based  upon  the  seriousness 
of  the  discrepancy).   Also  provided  is  a  statistical  summar'y 

of  discrepancy  levels  including  past  months'  performance  for 

measuring  trends  [Ref  14].   Tnis  report  format  is  a  classic 

case  of  identifying  problems  without  providing  a  methoc  for 

Solution.   A  necessary  change  to  the  report  is  the  inclusion 

of  a  more  precise  manner  for  identifying  the  deficiency.   The 

information  seems  to  be  available,  its  presentation  is  all 

that  is  lacking.  If  this  report  also  provided  a  statistical 

summary  of  steps  taken  to  prevent  the  discrepancies,  and  the 

success  obtained  in  doing  so,  then  it  would  be  of  much 

greater*  value  to  both  managers  and  small  purchase  buyers. 

The  large  contracts  report  is  similar  except  it  does  provide 

information  on  each  specific  deficiency.   The  only  change 

needed  here  is  one  on  action  taken  to  prevent  future 

occurrences  including  a  statistical  representation  of  the 

success  of  this  action. 
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The  Naval  Supply  Center,  Norfolk  is  v/ell  known  for 
its  heavy  involvement  in  support  to  the  fleet.   Surprisingly, 
their  concern  for  fleet  support  had  not  overwhelmed  their 
desire  to  turn  out  a  quality  product.   In  fact,  of  all  the 
activities  visited,  NSC  Norfolk  probably  had  the  most 
thorough  review  process  for  checking  the  quality  of 
acquisitions  [Ref  15].   It  also  had  a  strong  prograi.i  for 
ensuring  that  the  work  was  done  correctly  trie  first  time. 
Appendix  E  contains  the  tabs  used  to  help  contract 
specialists  ensure  Lhac  all  requireqi  docuujenta tion  and 
approvals  are  provided  as  part  of  the  contract  file.   They 
also  help  the  specialist  to  maintain  a  more  orderly  file  and 
ensure  all  requirements  are  met  without  referring  to  an  old 
file.   Referring  to  an  old  file  is  one  of  tne  surest  ways  to 
carry  a  mistake  on  from  contract  to  contract.   NSC  Norfolk 
was  not  the  only  activity  reviewed  that  used  organization 
tabs,  as  most  of  the  activities  had  discovered  chat  a  well- 
documented  file  is  one  of  tne  cornerstones  to  a  quality 
contract. 

Although  a  written  instruction  was  pending,  there  was 
action  being  taken  by  the  command  to  check  the  quality  of  the 
procurements  and  a  quality  group  had  been  established  within 
the  organization.   Both  a  contract  file  check  sheet  for  large 
contracts  (See  Appendix  F),  wliich  serves  as  a  double  check 
for  ensuring  the  contract  file  is  complete,  and  a  contract 
review  sheet  for  small  purchases,  which  serves  as  a  contract 
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quality  control  sheet  were  in  use  by  the  qual i ty  .  inspec tors . 
It  is  not  possible  to  be  sure  frora  the  reviev;,  but  it  is 
believed  that  the  contract  file  checklist  had  a  positive 
effect  on  tne  quality  of  the  contracts.   This  is  because  it 
v^as  another  aid  for  the  specialists  to  use  in  ensuring  the 
contract  was  coiaplete.   However,  since  the  contract  review 
sheet  provided  only  the  problems  noted  in  the  inspection  of 
the  purchase  by  quality  assurance  personnel  and  did  not 
provide  any  solutions,  it  is  felt  it  did  more  harm  than  good. 
There  was  also  no  attempt  being  made  to  retain  data  on  the 
level  of  quality  being  obtained  or    improvements  to  it, 
included  in  the  NSC  Norfolk's  quality  program. 

Finally,  most  of  the  work  that  had  been  done  in 
quality  assurance  had  not  been  the  result  of  action  from,  top 
management.   There  was  no  instruction  in  place  outlining  the 
quality  system  and  the  support  of  top  managemient  for  the 
progratawasnotreadilyapparent. 

The  three  regional  contracting  centers  reviewed, 
although  similar  in  contracting  responsibility  and  equal  in 
many  respects  in  the  MFCS,  nevertheless,  have  varying 
missions  and  approaches  to  quality.   MRCC  VJashington  and  NRCC 
Long  Beach  were  organized  with  in-house  contract 
administration  activities  separate  from  the  PCO.   In  both 
cases,  the  amount  of  contract  administration  effort  involving 
corrections  of  mistakes  by  PCO  personnel  was  suspected  as 
having  risen  as  a  result  of  implementation  of  the  PUFi  system. 
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In  one  esse,  trie  increase  resulted  in  a  tv.'ofold  increase  in 
contract  administration  backlog  [Ref  16].   At  the  other 
activity,  the  costs  of  this  extra  effort  on  the  part  of 
contract  administration  personnel  increased  tne  original  cost 
of  producing  the  contract  by  a  factor  of  alniost  three  in  sowe 
cases  [Ref  1?].   Since  IJRCC  Philadelphia  could  not  accurately 
measure  the  cost  of  contract  administration  due  to  its 
organizational  arrangement  [Ref  18],  it  is  not  possible  to 
correlate  it  with  the  other  two.   It  is  suspected  though  that 
since  the  PCO  in  NRCC  Philadelphia  was  responsible  for 
correcting  any  mistakes  made  in  tne  original  effort,  the 
number  of  errors  made  on  the  original  contract  was  less. 
NRCC  VJashington  was,  in  fact,  in  the  process  of 
reorganizing  to  hole  the  PCO  sections  accountable  for  the 
mistakes  made  in  the  original  procurement.   This  was  not, 
however,  accomplished  in  a  haphazard  manner.   The  PCO 
sections  were  reorganized  to  perform  this  new  tasking  by 
establishing  specialized  teams  v/ithir  the  sections.   In 
addition,  they  were  also  manned  to  allovN/  them  to  r.iore 
efficiently  execute  the  contract  correctly  the  first  tine. 
This  new  organization  provided  the  most  successful  approach 
to  improving  the  quality  of  its  contracting  product.   It  did 
however,  have  some  problems.   The  concept  of  quality  had  not 
yet  been  put  forth  as  the  one  that  was  key  to  the  successful 
operation  of  the  organization.   There  was  no  command 
instruction  in  place  outlining  details  of  the  quality  program 
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and  also  "  ins  ti  tu  tionai  izir.g"  it.   It  shoula  be  noted  that 
many  of  these  problems  were  tne  result  of  the  short  tirrie  that 
the  program  had  been  in  effect  and  it  is  suspected  that  they 
would  be  addressed  as  the  program  matured. 

NRCC  Washington  did  offer  one  of  the  most  interesting 
concepts  for  measuring  quality.   The  command  had  determined 
that  in  some  cases  as  much  as  three  times  the  amount  of 
effort  was  being  spent  in  contract  administration  correcting 
errors   made  on  the  original  contract  from  the  PCO  branch. 
This  caused  the  PUR  rate  to  go  up  because  money  was  being 
spent  in  contract  administration  to  correct  mistakes  that 
should  not  have  been  made.   For  example,  if  it  originally 
cost  $1000  to  complete  5  contracts  the  PUR  rate  would  be 
1000/5  or  $200  per  action.   Since  additional  contract 
administration  was  required  to  fix  the  contract,  however,  the 
rate  was  higher.   For  example,  $200  in  additional  admin  costs 
results  in  a  new  rate  of  1200/5  or  $240.   The  lack  of  quality 
in  the  original  contract  resulted  in  an  increased  cost  for 
completing  the  contract.   Because  contract  administration  was 
done  in  house,  the  rate  could  be  used  as  a  measure  of  quality 
and  therefore,  allowed  the  personnel  at  NRCC  V/ashington  to 
use  the  PUR  program  as  a  way  of  monitoring  and  improving 
qual i ty  . 

The  success  of  this  program  v;as  greatly  attributable 
to  its  environment.   Of  all  the  offices  visited,  NRCC 
Washington  had  the  most  stable  customer  base,  the  fewest 
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small  purchases,  the  lcv:est  fleet  support  requirements  and 
the  largest  local  r.;arket  from  which  zo    draw  resources.   Such 
conditions  gave  it  a  stability  that  allowed  a  greater  push 
into  the  area  of  quality  than  that  which  could  be  nade  by 
others  in  the  I.FCS. 

3 .   Current  USAF  Practices 

A  short  review  was  also  conducted  of  the  quality 
programs  currently  in  use  by  two  Air  Force  activities.   This 
was  done  partly  to  compare  the  current  practices  with  the 
reconmenda tions  and  findings  of  the  Air  Force  Acaaemy  study 
and  partly  to  get  a  perspective  different  frorn  tnat  which 
could  be  obtained  by  reviewing  only  Navy  activities. 

Two  different  comr.;ands  frora  two  different  systerr.s 
commands  v;ithin  the  Air  Force  were  interviewed  concerning 
tneir  quality  programs.   The  two  quality  programs  were  not 
the  same  but  did  have  scmie  cnarac ter ist ics  in  ccmmcn.   Both 
programs  had  dedicated  personnel  assigned  to  the  quality 
function  on  a  full-time  basis.   Also,  both  programs  primarily 
did  their  reviews  during  the  acquisition  process  rather  tnan 
after  the  contract  action  was  complete.   Finally,  both 
programs  concentrated  their  effort  almost  exclusively  on 
actions  above  the  small  purchase  threshold.   Differences  in 
the  two  programs  reviewed  centered  on  the  m.anner  in  which  the 
review  was  conducted  (e.g.,  whether  or  not  the  reviewer  used 
a  checklist)  and  the  organization  of  the  review  group  within 
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the  contracting  organization.   A  generic  description  of  the 
type  of  contract  quality  reviev;s  currently  being  used  VN/ithin 
the  Air  Force  follovvs. 

The  Air  Force  quality  prograni  is  intended  to  be 
primarily  a  pre-award  review  process  [Ref  191.   Its  purpose 
is  to  find  errors  and  correct  them  prior  to  releasing  the 
contractual  document.   The  reviews  are  conducted  throughout 
the  procurement  process  from  receipt  of  requirement  through 
contract  award  and  post  award.   The  timing  of  tt;e  review  and 
the  type  of  review  conducted  is  based  upon  the  dollar  value 
of  the  contract  and  the  type  of  supply  or  service  being 
obtained  by  contract  [Ref  20],   The  review  committee,  as  it 
is  known  in  the  Air  Force,  also  reviews  documents  related  to 
the  procurement  such  as  DD  Forms  350,  reviews  many  requests 
for  approval  at  higher  headquarters,  and  acts  as  the  in-house 
expertise  for  a  variety  of  procurement  related  problems. 

Although  the  Air  Force  quality  system  almost 
guarantees  the  quality  of  the  procurement  action,  it  does  so 
at  a  very  high  cost.   The  procurement  review  committee  is  a 
group  of  highly  professional  and  ex[)er ienced  contract 
specialists  performing  roles  as  inspectors  of  the  contractual 
documents.   As  discussed  previously,  placing  inspectors  in 
the  system  is  not  the  solution  to  improving  quality.   The 
comi.iittee  makes  no  reports  other  than  to  advise  the  PCO  of 
mistakes  found  in  the  contract  documentation  or  procedures. 
There  are  no  statistics  kept  of  what  errors  have  been  made. 
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Although  training  is  sometimes  given  and  trie  committee 
informs  the  purchasing  divisions  of  errors  that  are 
consistently  made  there  is  no  attempt  to  quantify  or  solve 
the  problems  using  proven  statistical  methods.   Also,  under 
the  current  system  there  is  no  motivation  for  the  PCC  co 
improve  the  work  of  his/her  per-sonnel  in  putting  together  a 
better  pi'oduct.   As  mentioned  earlier,  most  people,  if  avjare 
that  their  v;ork  will  be  checked  by  someone  else  for 
correctness  and  if  no  reason  is  provided  for  the  person  to 
make  as  perfect  a  proaujr  as  possible,  then  it  is  very  likely 
that  the  person  will  be  less  concerned  with  doing  it  right 
the  first  time. 

For  the  above  reasons,  it  is  likely  that  the  Air 
Force  is  paying  a  very  high  price  trying  to  inspect  quality 
into  their  procurement  product.   A  better  choice  would  be  to 
statistically  measure  the  quality  of  the  contracting  effort, 
provide  motivation  for  improving  the  quality  of  the  product, 
and  then  using  the  contracting  personnel  now  performing 
primarily  as  inspectors  to  help  improve  the  system  to 
increase  the  overall  quality  of  prccure^ients . 

C .   SUMMARY 

This  chapter  provided  a  review  of  a  past  study  on  quality 
as  well  as  a  discussion  of  current  practices  within  the  liFCS 
and  at  tvjo  Air  Force  bases.   This  background  was  intended  to 
aid  the  reader  in  understanding  how  the  concept  of  quality  is 
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being  applied  to  real  vv/orld  situations.   In  the  next  chapter', 
a  general  model  for  achieving  quality  in  a  contracting 
operation  will  be  presented. 
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IV.       PRQCL'REMEIiT   QUALITY    l-iODEL 

A.  INTRODUCTION 

The  first  three  chapters  of  this  thesis  introduced  the 
subject  cf  procurement  quality,  provided  a  background  in 
quality  theories  and  the  NFCS  productive  unit  resourcing 
system,  described  past  studies  of  procureaent  quality,  and 
described  some  of  the  current  quality  programs  both  within 
and  outside  of  the  Navy  Field  Contracting  System  (i^FCS).   The 
intent  of  this  cnapter  is  to  bring  the  concepts  and  practices 
discussed  earlier  into  focus  with  the  intent  of  developing  a 
model  foi^  iu;proving  contract  quality  for  botn  large  and  small 
dollar  procurements  witnin  the  NFCS.   It  is  hoped  that  field 
personnel  will  find  the  information  provided  here  beneficial 
in  improving  the  overall  quality  of  their  contracting  efforts 
and  will  not  consiaer  the  infcriaation  to  be  another  burden 
under  which  they  must  accomplish  their  tasks. 

B.  REViEVJ 

Before  going  much  further  into  the  discussion,  a  quick 
review  of  Dr.  Deming's  fourteen  points  [Ref  8:pp.  16-1?]  for 
achieving  quality  as  well  as  a  reaffirmation  of  the  five 
quality  principles  listed  in  Chapter  2  might  be  beneficial. 
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Dealing's    fourteen    points    are: 

1.  Create  constancy  cf  purpose  for  improvement  of  product 
and  service. 

2.  Adopt  the  new  philosophy. 

3.  Cease  dependence  on  mass  inspection. 

4.  End  the  practice  of  awarding  business  on  the  basis  of 
price  tag  alone. 

5.  Find  problems,  and  constantly  and  forever  seek  ways  uo 
improve  the  system. 

6.  Institute  modern  methods  of  training  on  the  job. 

7.  InstituLe  modern  methods  of  supervision. 
8  .  Drive  ou  t  fear . 

9.  Break  down  barriers  between  departments. 

10.  Eliminate  numerical  goals  that  ask  for  new  levels  of 
productivity  without  providing  methods  for  improvement. 

11.  Eliminate  work  standards. 

12.  Remove  barriers  that  hinder  the  worker. 

13.  Institute  a  vigorous  program  of  education  and  training. 

14.  Create  a  structure  in  top  management  that  will  push 
every  day  on  the  above  13  points. 

The  five  general  principles  of  quality  noted  in  Chapter  2 

of  this  thesis  are: 

1.  Measures  of  quality  vary  according  to  the  product  and 
the  needs  of  the  customers. 

2.  Improving  quality  is  a  long-term,  never-ending  process. 

3.  Dedication  to  quality  must  be  total. 

4.  Improving  the  workers  is  not  the  answer,  improving  the 
system  is. 

5.  Quality  cannot  be  assured  through  mass  inspection. 
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1/ith  the  above  ideas  in  mind  it  is  possible  to  enumerate 
the  basic  cnarac  ter  ist  ics  of  a  quality  program  for  the  i'JFCS 
procurement  organization. 

C.   GENERAL  FRAMEWORK  FOR  A  QUALITY  PROGRAM 

There  are  three  basic  steps  to  achieving  and  maintaining 
quality.   The  first  is  to  establish  a  program,  that  leads  to 
quality  improvements.   The  next  step  is  to  obtain  a  measure 
of  v;hat  the  level  of  quality  is  at  a  given  point  in  time. 
The  final  step  is  the  process  of  improving  quality.   Althougn 
this  is  tne  final  step  in  the  quality  R;odel,  the  effort 
required  to  achieve  quality  does  not  end  here.   This  tnree 
step  cycle  continues  forever.   As  conditions  change,  the 
program  adapts  to  the  changes  by  redefining  quality 
requirements  or  redefining  measures,  but  the  overall  process 
remains  the  same. 

The  bulk  of  this  thesis  is  concerned  with  the  first  and 
third  steps  of  this  three  step  process.   V/hat  is  needed  to 
obtain  quality  and  what  action  can  be  taken  to  improve  it? 
These  are  the  questions  that  involve  these  parts  of  the 
quality  model.   However,  the  second  step,  measuring  quality, 
is  just  as  important  as  the  other  two  in  the  overall  quality 
program.   Therefore,  the  remainder  of  this  chapter  will 
attempt  to  show  how  this  three  step  process  can  work  to 
achieve  quality  in  an  organization. 
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1  .   step  One  -  Achieving  Quality 

This  part  of  the  chapter  concerns  the  types  of  action 
that  are  needed  to  be3;in  a  quality  program.   Some  of  the 
items  discussed  here  may  seem  to  be  simple  management, 
h.owever,  it  should  be  remembered  that  thiis  program  is 
concerned  with  the  attainment  of  quality.   In  the  normal 
course  of  day-to-day  actions,  managers  are  concerned  v;ith 
mjany  aspects  of  the  organization  -  productivity,  payroll, 
competition,  and  many  others.   This  program  is  concerned  only 
v^/ith  the  achievement  of  quality.   It  is  felt  tnat  by 
concentrating  on  thiis  alone,  thiC  overall  organization  will 
improve . 

In  order  for  a  quality  program  to  succeed  there  is  an 
important  condition  that  must  first  be  met.   This  condition 
is  one  of  an  overall  understanding  throughout  the 
organization  that  quality  is  of  paramount  concern.   This  can 
only  be  achieved  if  employees  are  convinced  that  managemient 
is  completely  supportive  of  the  quality  doctrine.   Positive 
steps  must  be  taken  by  m.anagement  if  they  are  to  convince 
employees  of  this.   A  likely  first  step  would  be  to  appoint  a 
quality  control  officer  and  a  quality  control  organization  in 
any  procurement  organization  that  does  not  already  have  one. 
VJith  the  limited  manning  and  funding  levels  available  in 
today's  environmient ,  this  step  m^ay  appear  to  many  to  be  a 
further  tax  on  shrinking  resources.   However,  as  was  shown  in 
Chapter  2  improving  quality  does  save  money  in  the  long  run. 


55 


and  in  order  to  achieve  quality,  positive  action  must  be 
taken  to  give  it  a  firm  foothold  in  the  bureaucracy. 
Appointing  quality  control  officers  at  contracting  activities 
does  much  to  aid  tnis  effort.   In  addition,  to  ensure  that 
management  at  field  activities  is  as  convinced  as  their 
employees,  a  quality  control  "czar",  if  you  will,  should  also 
be  appointed  at  NAVSL'P  headquarters  to  oversee  the  efforts  of 
the  field  representatives.   This  action  will  not  only  aid  in 
institutionalizing  the  quality  doctrine,  but  will  provide  a 
central  point  within  the  KFCS  to  address  problems  founc  in 
improving  quality. 

Training  is  another  important  aspect  to  the  first 
step  of  the  quality  program.   Because  the  requirements  for 
putting  together  a  Government  contract  are  many  and  vary 
according  to  the  supply  or  service  being  produced  as  well  as 
a  myriad  of  other  factors,  there  is  no  one  place  that  all 
contract  specialists  can  go  to  learn  their  job.   Although 
there  are  some  short  courses  that  are  required  for 
advancement  to  certain  levels  and  sorre  requirements  for  entry 
level  personnel,  for  th.e  most  part,  training  for  contract 
specialists  in  the  governm.ent  is  an  on-going  process  with  a 
great  deal  of  on-the-job  training  involved.   Therefore,  if  an 
operation  is  to  achieve  a  high  level  of  quality  in  large 
contract  or  small  purchase  production  it  is  important  that  it 
start  with  a  strong,  dynamic  training  program  that  includes 
rigorous  classroom,  as  well  as  on-the-job  instruction.   The 


56 


more  vigorous  the  training  program    the  j^reater  the  chances 
that  the  work  force  will  be  capable  of  producing  high  quality 
work,  and  the  ease  of  ir.iplementing  system  changes  to  improve 
quality  will  be  enhanced.   No  activity  should  expect  full 
production  or  quality  from  any  of  its  buyers  that  have  not 
had  the  benefi. t  of  a  solid  education  in  contracting  basics. 

Management  reviews  are  another  important  method  of 
improving  and  ensuring  quality.   They  are  also  one  of  the 
areas  where  practices  for  improving  quality  in  large  and 
small  contracts  differ. 

It  is  probably  unreasonable  to  expect  all  contract 
specialists  to  have  the  comprehensive  knowledge  required  to 
correctly  complete,  in  the  first  attempt,  a  large  contract 
award.   Of  necessity,  the  system  has  reviews  and 
specialization  built  into  it.   This  team  approach  to  contract 
execution  has  been  effectively  used  throughout  the  governriien t 
and  there  is  no  evidence  to  support  a  change  in  this 
strategy.   There  are  probaoly  already  enough  in-work  reviews 
in  the  current  large  contract  processing  system.   A  contract 
specialist  receives  the  requisition  and  begins  to  prepare  a 
solicitation  to  request  bids  on  the  v^jork.   During  this  phase 
and  throughout  the  procurement  cycle  the  specialist  has 
available  the  advice  and  assistance  of  pricing  specialists, 
technical  specialists,  lawyers,  superiors  and  a  host  of 
others.   Depending  on  the  dollar  value  and  type  of  itemi  being 
purchased,  there  are  several  reviews  by  committees  and 
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officials  higher  in  the  chain  of  command  that  may  also  be 
required.   Simply  put,  there  seem  to  be  sufficient  checks  in 
the  system  to  ensure  that  large  contracts  are  properly 
prepared. 

However,  as  small  purchases  are  intentionally  made 
more  simple  to  complete,  it  is  not  unreasonable  to  expect 
buyers  to  be  able  to  complete  them  properly  on  their  own 
after  a  short  period  of  learning.   This  lessens  the  need  for 
reviews  by  management  that  are  the  norm  in  the  large  contract 
arena.   This  tenas  to  allow  a  greater  chance  cf  proolems  with 
quality  in  small  purchase   production.   Therefore,  a  regular 
review  of  purchases  made  by  buyers  should  probably  be 
conducted  by  their  superiors.   This  review  should  not  be  mace 
of  every  requisition  as  that  will  result  in  a  lowering  of 
quality  and  morale  as  discussed  in  previous  chapters.   The 
review  is  instead  a  reaffirmation  to  employees  cf 
management's  concern  for  quality  as  well  as  an  additional 
check  for  problems  that  may  be  highlighted  by  quality 
inspectors  as  discussed  in  the  next  section. 
2 .   Step  Two  -  Measuring-;  Quality 

The  second  step  to  the  quality  miodel  is  to  measure 
the  level  of  quality  in  the  organization.   As  discussed  in 
Chapter  3,  there  are  many  ways  to  do  this.   The  Aviation 
Supply  Office  uses  a  discrepancy  level  based  on  the  number  of 
errors  found  in  a  review  of  files  to  determine  how  its 
contract  sections  are  doing  in  providing  quality  output. 
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NRCC  Washington,  on  the  other  hand,  uses  the  PUR  rate  to 
measure  its  quality.   These  riiethods  are  both  effective  and 
there  are  many  others  that  'would  provide  equally  useful 
measures  of  quality.   The  following  paragraphs  outline  a 
general  method  for  nieasuring  quality  that  niight  be  adopted  oy 
organizations  without  programs  currently  in  place. 

This  is  the  area  that  the  use  of  statistical  methods 
first  comes  into  practice.   Like  the  program  at  ASO,  the 
following  program  uses  saniples  of  the  contracting  product  to 
measure   quality.   Deraing's  third  point  warns  that  mass 
inspection  is  harmful  to  quality.   If  a  worker  is  aware  that 
in  every  case  his/her  work  will  be  inspected  by  another 
person  before  it  is  completed,  he/she  is  much  more  likely  to 
be  less  concerned  with  the  quality  of  the  effort  the  first 
time  through.   If,  on  the  other  hand,  an  employee  is  aware 
that  he/she  will  be  responsible  for  the  complete  product, 
they  are  more  likely  to  be  concerned  with  getting  it  right 
the  first  time.   This  is  the  thrust  behind  the  fifth  quality 
principle  cited  in  this  thesis,  quality  cannot  be  achieved  by 
mass  inspection,  it  must  be  an  integral  part  of  tiie  process 
from  the  beginning. 

Inspection  on  a  sample  basis  is,  however,  still  a 
necessary  part  of  the  overall  program.   There  must  be  some 
measure  of  how  the  organization  is  doing  with  respect  to 
quality.   Samples  of  the  finished  product  provide  this 
function  without  atten;pting  to  correct  the  mistake  before  it 
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goes  out  the  door.   This  ensures  responsibility  for  the 
product  quality  rests  vjith  the  worker,  and  still  gives  a 
nieasure  of  how  the  system  is  doing  overall. 

Under  this  model  a  quality  inspection  of  randorr.ly 
selected  contractual  docun^ents  would  be  conducted  by  the 
quality  control  organization  previously  mentioned  to  gain  a 
measure  of  the  level  of  quality  at  the  activity.   A  checklist 
such  as  Appendix  G  for  small  purchases  and  Appendix  H  for 
large  purchases  should  be  used  as  a  guide  during  the 
inspection  to  ensure  consistency  ana  completeness.   If  the 
quality  program  will  oe  controlled  internally  then  individual 
command's  management  can  use  its  discretion  in  this  regard. 
However,  if  an  NFCS  system-wide  quality  progr-am  will  be  used 
and  activities  are  to  be  compared,  then  a  cor.imon  check  sheet 
must  be  used  and  inspectors  should  be  trained  to  ensure 
similarity  of  inspections  among  activities.   Appendices  G  and 
H  are  provided  as  a  basis  for  such  a  check  sheet  and  must  be 
expanded  to  provide  coverage  of  the  broad  range  of  areas 
included  in  the  MFCS  as  a  whole. 

The  sample  selected  for  review  should  be  large  enough 
to  ensure  it  is  representative  of  the  entire  operation.^ 
There  are  many  statistical  methods  that  might  be  used  to 
determine  how  to  establish  a  quality  level  based  on  the 


2   An  excellent  guide  for  sampling  techniques  is  contained  in 
V/estern  Electric 's  Statistical  Quality  Control  Handbook.   In 
fact,  this  book  as  well  as  others  listed  in  the  bibliography  are 
excellent  sources  for  quality  control  personnel  to  research  for 
finding  statistical  models  for  their  quality  programs. 
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results  of  the  quality  inspection.   A  simple  choice  is  to  use 
the  percentage  of  documents  ivithout  errors  as  the  measure. 
Other  more  complex  methods  could  also  be  used.   The  m.ore 
definitive  the  statistical  method  used  to  measure  quality  is, 
the  more  useful  it  vjill  be  for  improving  quality. 

Another  measure  that  would  appear  useful  is  that  of 
customer  satisfaction.   As  the  customer  is  the  most  important 
source  of  quality  input  of  any  service  oriented  or^^an  ization , 
including  government  purchase  activities,  any  prograi.;  that 
did  not  include  them  would  be  incomplete.   However,  as 
pointed  out  in  Chapter  3,  measuring  quality  through  customers 
is  difficult  to  do.   The  key  to  using  this  input  successfully 
is  to  control  the  types  of  responses  that  are  allowed  and  to 
limit  their  effect.    This  can  be  done  by  careful  selection 
of  the  questions  asked  of  the  customers.   A  customer 
satisfaction  form  with  sample  questions  is  provided  as 
Appendix  I  to  this  thesis.   This  form  offers  generic 
inforn.a tion  as  to  the  overall  effectiveness  of  the  operation 
as  well  as  providing  data  that  may  be  useful  tc  the  quality 
personnel  in  determining  other  problem  areas. 

It  should  oe  remembered  by  anyone  attempting  to 
develop  an  overall  quality  program  for  comparing  different 
activities,  that  an  activity  which  is  able  to  foster  good 
customer  relations  in  spite  of  low  contract  quality,  may  fair 
better  on  this  measure  than  one  with  higher  quality  and  m.ore 
demanding  customers.   The  combination  of  internal  inspection 
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and  input  frora  custcmeri)  shoulrl  provide  adequate  information 
for  r.easuring  quality.   Assuming  that  measures  of  BOfi 
accuracy  v;ere  obtained  from  the  inspection  of  documents  and 
85S  of  the  customers  surveyea  were  pleased  with  the  quality 
of  the  contracts  the  next  step  is  to  improve  on  these 
percentages  by  finding  problems  and  correcting  tnem. 
3 .   Step  Three  -  Improving  Quality 

The  use  of  statistical  measures  of  quality  does  not 
end  with  its  initial  measure.   Once  m.anagement  is  made  aware 
of  its  quality  level,  it  must  take  action  to  determine  where 
the  system  can  be  im.proved  to  assist  the  worker  in  making  a 
quality  product.   Some  areas  to  consider  in  attempting  to 
improve  the  system  include:   Is  training  adequate?   Is  the 
manning  level  commensurate  with  the  workload?   Does  the 
quality  of  the  incoming  requisition  hamper  the  buyer's 
ability  to  turn  out  a  quality  purchase?   Are  there  o::.her 
methods  or  procedures  whicli,  if  used,  could  improve  the 
buyer's  ability  to  produce  a  higher  quality  product  in  the 
sar.ie  or  even  less  time?   Questions  such  as  these  and  a  ruyriad 
of  others  (See  Section  B  of  Appendices  G  and  H)  should  be 
asked  by  management  in  attempting  to  improve  quality.   If  it 
appears  that  a  change  to  tlie  system  may  be  beneficial,  it 
should  be  incorporated. 

It  is  when  changes  are  made  that  the  real  value  of 
statistical  methods  takes  place.  A  relatively  constant  level 
of  quality  (or  measure  thereof)  should  be  available  prior  to 


62 


testing  the  effect  of  a  change  to  the  system.   When  the 
change  is  implemented  the  change  in  quality  sliould  be 
measured  to  determine  if  the  change  had  a  positive  or 
negative  effect,  as  well  as,  the  magnitude  of  the  effect. 
Then  tne  question  becomes:  Is  the  increase  in  quality 
sufficient  to  justify  the  change?  If  so,  then  the  change 
should  be  made  pernanent.   If  not,  then  it  shouldn't  be 
retained. 

Assume  that  the  80;j  accuracy  rate  noted  above  v;as 
determined  to  be  caused  in  part  by  an  incoinplete 
justification  for  sole  source  procurements.   Upon  institution 
of  training  in  this  area  the  overfall  accuracy  rate  vjas  raised 
to  837j  and  the  errors  based  on  sole  source  justification  v;ere 
reduced  to  zero.   This  is  the  type  of  process  that  must  take 
place  to  ensure  quality  improvements. 

The  use  of  sucn  methods  is  not  as  simple,  nor  as 
quick,  as  their  description  here.   This  fact  is  one  of  the 
primary  reasons  that  the  estaol ishmen t  of  quality 
professionals  in  the  contracting  system  is  central  to  the 
successful  implem.entation  of  a  viable  quality  program. 
4 .   Manning  the  Quality  Model 

The  manpower  requirements  for  a  program  such  as  tne 
one  outlined  above  laay  seem»  prohibitive.   However,  one  of  the 
activities  visited  during  the  research  portion  of  this  thesis 
had  successfully  used  its  Naval  Reserve  units  in  assisting  in 
the  quality  effort  for  small  purchases  [Ref  16].   As  all  of 
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the  major  buying  activities  within  the  NFCS  currently  have 
Reserve  units  assigned,  it  is  suggested  that  this  may  be  a 
very  cost  effective  method  of  iniproving  the  quality  of  the 
small  purchase  organization  and  tne  buying  knov/ledge  of  the 
Reserve  unit  at  the  same  time. 

The  use  of  Reserve  personnel  is  more  difficult  witn 
large  contracts,  however,  due  to  the  greater  complexities 
involved  in  these  actions.   There  is  a  definite  need  for  n.ore 
personnel  in  order  to  properly  conduct  a  quality  program  for 
large  contracts.   Depending  on  the  office  organization,  these 
could  be  gained  by  changes  tliat  free    sor.;e  personnel  from 
their  current  duties  (e.g.,  dises taol ishment  or  down  loading 
of  contract  administration  sections.)   Tne  use  of  Reserve 
personnel  may  be  possible  in  some  instances,  but  the 
likelihood  of  finding  Reserve  personnel  capable  of  properly 
evaluating  complex  large  contracts  is  remiote  for  most 
offices.   As  a  result,  tiie  bulk  of  large  contract  quality 
wor-k  will  have  to  be  performed  by  permanent  quality 
personnel.   Though  the  investment  here   may  be  great  in  some 
instances,  the  overall  gain  to  the  purchasing  activity  and 
its  customers  should  prove  beneficial. 

D.   SUMMARY 

A  review  of  the  five  contracting  principles  and  their 
relationship  to  tne  three  step  contract  quality  program  may 
be  helpful  at  this  point. 
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The  first  principle  is  that  measures  of  quality  vary 
according  to  the  product  and  the  needs  of  the  customers. 
Designing  a  quality  control  syster.i  within  the  NFCS  should 
allow  for  the  recognition  of  the  variations  between  offices 
under  the  MFCS  and  also  provide  for  some  central  quality 
policies  for  the  systera.   There  are  and  should  be  tremendous 
differences  between  an  office  that  is  primarily  involved  in 
fleet  support  and  one  that  is  concerned  with  shore  support. 
Quality  concerns  could  also  be  expected  to  be  different. 
Correctness  of  the  incoming  requisition  can  be  a  key  point 
for  the  shore  oriented  operation,  while  the  same  requirement 
may  be  unrealistic  to  the  ship  oriented  corninand.   It  is 
important  to  note  that  due  to  the  overall  similarity  of  the 
mission  in  the  commands  under  the  UFCS   a  case  can  be  made  for 
identical  quality  standards  to  be  placed  on  a] 1  of  them.   If 
this  were  done,  assigning  the  different  commands  a  different 
quality  level  to  maintain  in  light  of  their  circumstances 
would  be  a  viable  way  of  taking  this  variability  of  quality 
into  account.   The  quality  control  personnel  at  each  of  these 
commands  must  be  aware  of  these  differences  and  must  build  a 
quality  system  that  keeps  them  in  mind.   At  the  san:e  time, 
they  must  tielp  the  central  quality  control  personnel  at 
headquarters  understand  these  differences  and  assist  in 
finding  common  measures  of  quality  for  all  the  commands. 

This  variation  of  quality  requirements  is  one  of  the 
reasons  that  improving  quality  is  a  long-term,  never-ending 
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process  (the  second  principle).   Perfection  in  any  particular 
area  is  an  unlikely  achievenien t  at  best.   Striving  for  iu, 
however,  is  a  worthy  goal.   The  quest  for  achieving  quality 
will  never  end  because  the  possibility  of  error  will  never  be 
zero.   In  addition,  the  procurei.:en t  system  of  the  United 
States  Government  is  in  a  constant  state  of  change. 
Congress,  the  Executive  Branch  and  the  Judicial  Branch  of  tne 
government  create  chan^^es  to  the  system  almost  daily,   i^s 
those  changes  occur  their  effect  on  the  quality  of 
procurements  must  be  measured  and  evaluated.   Though  the 
overall  n.ission  of  the  iJFCS  may  remain  constant,  how  it  goes 
about  performing  this  mission  is  likely  to  be  affected  by 
many  changes  in  the  acquisition  field.   The  push  for 
competitive  awards  of  contracts  and  the  more  recent 
establishment  of  the  streamlining  advocate  are  two  examiples 
of  changes  to  the  system  that  must  be  adapted  into  a  complete 
quality  system. 

The  quality  organization  should  also  be  concerned  with 
finding  the  reasons  for  problems  in  quality.   Due  to  the 
complexity  of  large  dollar  procurements  and  tne  organization 
of  the  contracting  system,  this  process  will  be  a  constant 
series  of  solving  problem.s,  finding  new  ones  and  their 
causes,  solving  those  anc  beginning  the  process  again. 
Changes  in  the  regulations  concerning  government  contracts, 
changes  in  customers,  and  changes  in  personnel  as  well  as 
other  factors  all  wor-k  to  keep  the  system  in  a  constant  state 
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of  flux.   Tnis  condition  should  be  recognized  and  flexibility 
r.iust  be  maintained  in  developing  a  contract  quality  program. 

Total  dedication  to  quality  is  probably  one  of  the  more 
difficult  principles  to  achieve.   The  establishment  of 
quality  control  officers  will  assist  in  achieving  this  third 
principle.   The  PUR  system  can  be  an  excellent  program  for 
funding  contracting  activities,  if  the  quality  of  the 
contract  is  a  consideration  of  the  program.   HovN'ever,  unless 
this  is  the  case,  the  PUR  system  puts  overwhelming  emphasis 
on  the  quantity  of  contracts.   As  noted  in  Chapter  3,  this 
emphasis  can  directly  affect  the  quality  of  the  product. 
Until  the  quality  of  the  contract  is  considered  to  be  a  key 
factor  in  the  system,  it  will  not  be  a  major  concern  of  the 
contract  specialist. 

The  fourth  principle  of  quality,  improving  the  workers  is 
not  the  answer,  improving  the  systen.  is,  should  be  remembered 
when  any  effort  is  made  to  improve  quality.   Once  the 
training  program  is  in  place  and  is  being  followed  and 
adequate  reviews  are  established  to  ensure  that  the  quality 
concept  is  understood  by  the  workers,  any  gains  in  quality 
must  be  obtained  through  improvements  to  the  system,  not  the 
people.   The  quality  control  organization,  using  the  tools  of 
random  inspection  and  statistical  methods  to  find  problems, 
to  detect  the  source  of  problems,  and  correct  them,  helps 
management  to  improve  the  system  in  which  the  contract  is 
produced.   Given  a  static  environment,  asking  employees  that 
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are  already  working  as  well  as  they  can  to  do  better,  will 
not  increase  quality  but  will  probably  decrease  job 
satisfacuion  and  lower  morale.   This  will  likely  decrease  th-e 
level  of  quality.   If  on  the  other  hand,  employees  see  that 
management  is  truly  concerned  with  quality  as  evidencec  by 
the  addition  of  quality  experts  to  the  organization,  and  also 
see  an  intelligent  attack  on  quality  probleiris  with  saniple 
data  and  quality  measures,  their  concern  for  quality  will 
grow . 

The  use  of  random  samples  is  basic  to  the  last  principle, 
that  quality  cannot  be  achieved  through  laass  inspection. 
Saraples  provide  a  measure  of  the  quality  of  the  product. 
Statistical  methods  aid  managers  in  measuring  quality, 
finding  the  source  of  problems,  an.d  measuring  the  effect  of 
changes  made  to  solve  the  problems.   If  the  buyer  is 
untrained  in  procedures,  inspecting  every  item  will  increase 
the  likelihood  that  all  the  mistakes  are  found,  but  they  must 
still  be  correctea.   Proper  training  will  allow  the  buyer  to 
complete  the  contract  tlie  first  tinie  and  eliminate  tiie  need 
for  the  mass  inspection  of  output.   Analysis  of  statistical 
data  v^/ill  highlight  for  management  those  areas  VN/here  training 
must  be  improved. 

Finally,  it  shoulc  be  remembered  that  one  of  the 
fundamental  aspects  of  a  complete  quality  program  is  that  the 
program  covers  the  entire  operation.   Although  it  has  been 
stated  that  a  saiiipling  method  should  be  used  for  checking  the 
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quality  of  the  final  product,  this  is  not  where  the  program 
snould  concentrate  all  of  its  efforts.   This  is  especially 
true  vjhen  atterapting  to  improve  the  system  during  the  third 
step  of  the  quality  prograr;;.   The  overall  operation  snould  oe 
reviewed  from  beginning  to  end.   Are  there  clear  operating 
procedures  in  place  throughout  the  operation  that  are 
followed  by  the  employees?   Are  the  requisitions  given  to  the 
buyers  com.plete  enough  to  allow  them  to  do  their  job?   Are 
there  bottlenecks  in  the  system  that  cause  delays  or  act  as 
"barriers"  that  prevent  the  specialist  from  completing  the 
contract  in  a  timely  manner  [Ref  8:p.  431? 

It  may  appear  that  some  of  these  questions  should  be 
asked  by  managers  and  resolved  in  the  normal  course  cf  their 
job,  so  that  the  need  for  quality  specialists  is  not  valid. 
In  truth  though,  if  these  questions  are  asked,  the  course  cf 
action  that  is  followed  to  resolve  the  problem  is  often 
guesswork  on  the  part  of  management  with  no  well  planned 
method  of  determining  its  effect  on  the  problem.   Just  as 
often  the  problem  is  not  resolved  or  not  discovered  because 
some  other  problem,  seemingly  more  important  at  the  tin;e, 
requires  management's  attention.   A  permanent  quality  staff 
guarantees  that  concei'n  for  quality  will  not  be  overruled  by 
the  "latest  flail".   At  the  same  time,  it  ensures  that 
actions  taken  to  improve  quality  can  be  measured  and 
withdrawn  if  ineffective. 
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V.   CONCLUSIOIIS  AND  RECOMMEMDATIQNS 

A.   INTRODUCTION 

This  thesis  has  attempted  tc  provide  a  background  on  v;hat 
quality  is,  its  status  v/ith  regard  to  the  coTipletion  of 
contractual  actions,  and  a  basic  model  for  improving  the 
quality  of  contracts  v^/ithin  the  NFCS.   The  following  is  a 
presentation  of  the  principal  conclusions  and  recommendations 
of  tne  thesis. 


B.   COHCLUSIONS 

Conclusion  1,   A  quality  procurement  is  one  that  provides 
to  the  customer,  the  desired  item  or  ser'vice  within  the  time 
required  at  a  fair  and  reasonable  price  that  is  ir  the  best 
overall  interests  of  the  Government  and  that  is  in  cor.ipliance 
with  the  rules  and  regulations  that  govern  such  a 
procurement . 

This  is  the  definition  of  a  quality  procurenient  that  was 
used  for  the  purposes  of  this  thesis.   It  r.ieets  the  needs  of 
customer  satisfaction,  compliance  with  regulations  and 
correctness  of  the  purchased  product  compared  to  the  item 
requested,   Uithin  this  definition  of  quality  is  a  wide  range 
of  quality  levels.   From  the  basic  tool  required  for  the  job 
to  the  finest  tool  ever  made,  there  are  many  different 
quality  levels.   The  key  is  to  find  the  level  that  is  desired 
and  to  woi'k  tov/ards  it  using  proven  quality  concepts. 
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Conclusion  2.   The  Purchase  Unit  Resourcing  (PUB)  system 
currently  used  for  funding  activities  within  the  ilFCS  places 
emphasis  on  quantity  rather  than  quality  of  the  contracting 
product. 

The  reason  for  this  is  that  the  quantity  of  output  is  the 
basis  for  funding  NFCS  activities.   As  long  as  there  is 
greater  emphasis  placed  on  the  quantity  of  the  product 
instead  of  the  quality  of  the  product,  the  quality  v;ill 
suffer . 

Conclusion  3.   There  are  five  basic  principles  of  quality 
that  should  be  remembered  when  establishing  a  quality 
program.   These  principles  are: 

1.  Measures  of  quality  vary  according  to  the  product  and 
the  needs  of  the  customers. 

2.  Improving  quality  is  a  long-term,  never-ending  process. 

3.  Dedication  to  quality  must  be  total. 

4.  Improving  the  workers  is  not  the  answer,  improving  tne 
system  is. 

5.  Quality  cannot  be  achieved  through  mass  inspection. 
These  principles  are  gleaned  from  the  works  of  Deming 

and  Guaspari.   They  focus  on  the  some  of  the  more  important 
concepts  of  attaining  quality. 

Conclusion  4.   Most  offices  that  were  reviewed  have 
recognized  the  need  for  improving  the  quality  of  the 
contracting  product  and  have  established  quality  programs. 

I'lanagers  in  the  field  seem  to  have  determined  that  action 
must  be  taken  to  ensure  the  contractual  product  that  they 
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produce  is  of  a  high  quality.   At  the  same  tin:e,  other 
requirements  such  as  a  heavy  workload  and  increasing 
complexity  of  the  contracting  process  have  made  it  difficult 
for  them  to  make  great  strides  in  improving  quality.   It  is 
hoped  that  some  of  the  ideas  expressed  in  this  thesis  vnll  be 
of  use  in  overcoming  some  of  these  problems. 

C.   RnCOMMENDATIOIiS 

The  following  recommendations,  if  impleniented ,  should 
result  in  improved  contract  quality  within  the  FIFCS. 

Recor.imendat ion  1.   The  xNFCS  should  appoint  quality 
control  officers  at  each  of  its  major  buying  activities  to 
head  up  a  quality  control  organization  and  at  NAVSUP 
headquarters  a  quality  control  "czar"  should  be  tasked  to 
administer  an  overall  quality  program  and  ensure  that 
emphasis  on  quality  is  maintained  throughout  the  system. 

This  is  an  inportant  first  step  in  the  establishment  of 
quality  programs.   This  quality  control  officer  will  help  to 
"institutionalize"  ttie  concept  of  quality,  provide  a  central 
point  where  quality  concerns  and  concepts  can  be  discussed 
and  will  provide  the  tools  necessary  to  put  into  place  the 
concepts  of  the  quality  put  forth  in  this  thesis. 

Recommendation  2.   The  NFCS  should  adopt  the  quality 
model  presented  in  this  thesis  to  improve  the  quality  of  , 
procurements . 
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The  three  step  process  of  achieving  quality,  measuring 
quality,  and  improving  upon  that  level  of  quality  offers  a 
clear  systematic  way  to  improve  the  level  of  quality  in  an 
organization.   The  program  is  also  flexible  enough  to  be 
adapted  to  a  wide  variety  of  organizational  arrangeuients  and 
the  many  changes  that  are  the  nature  of  the  procurement 
process . 

Recommendation  3.   The  PUR  system  should  be  changed  to 
ensure  tnat  the  emphasis  on  quantity  alone  is  shifted  to 
include  quality  of  the  contracting  product  as  well. 

Two  activities  that  were  reviewed  already  have  programs 
that  might  be  used  to  accomplish  this  action.   The  Aviation 
Supply  Office  develops  a  discrepancy  level  that  is  used  to 
measure  the  quality  of  its  procurements.   liRCC  VJashington 
measures  their  quality  by  determining  how  much  of  their 
contract  administration  activity  is  a  result  of  mistakes  made 
by  the  PCO  branches.   Either  of  these  methods  or  a 
combination  of  both  or  some  other  method  yet  to  be  developed 
should  be  used  to  increase  the  eiaphasis  on  quality  in  the 
system.  P    possible  example  is  to  simply  subtract  actions 
that  fail  a  quality  check  from  the  number  completed  for  the 
determination  of  funding  by  units  completed.   Before  action 
is  taken  with  respect  to  this  recommendation,  however,  all 
activities  should  have  an  opportunity  to  establish  quality 
programs.   Placing  new  requirements  for  quality  on 
organizations  without  providing  them  the  tools  with  which  to 
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accomplish  them  goes  against  many  of  the  concepts  put  forth 
in  this  thesis.   Such  action  will  probably  cause  harm  to  the 
quality  of  the  contracts  and  at  the  same  time  provide 
inaccurate  measures  due  to  "gaming"  of  tne  results  by 
activities  put  in  this  poor  position. 

D.   SUMMARY 

1  .   Answers  to  Research  Questions 

Primary  Research  Question:   Kov;  can  improved  quality 
of  contractual  actions  be  achieved  in  the  ilavy  Field 
Contracting  System? 

A  general  quality  model  for  achieving  quality  in 
contracts  is  presented  in  Chapter  4  of  this  thesis.   This 
model  if  comoined  with  the  establ  islimen  t  of  quality  control 
officers  within  the  MFCS  should  result  in  a  measurable 
improvemient  in  the  quality  of  contracts  produced  by  the  T^FCS. 

Ancillary  Research  Questions: 
1.  V/hat  is  the  definition  of  quality  in  contracting? 

A  quality  contract  is  defined  as  one  that  provides  to 
the  customer,  the  desired  item  or  service  within  the  time 
required  at  a  fair  and  reasonable  price  that  is  in  the  best 
overall  interests  of  the  Government  and  that  is  in  com.pliance 
with  the  rules  and  regulations  that  govern  such  a 
procurem.ent . 
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2.  Hew  is  quality  currently  measured  within  the  NFCS? 

There  is  now  no  single  measure  of  quality  within  the 
NFCS.   Two  of  the  activities  that  were  reviewed,  KF.CC 
Washington  and  the  Aviation  Supply  Office  had  quality 
programs  in  place  that  offered  some  nieasure  of  the  quality  of 
the  contracts  produced.   NRCC  V/ashington  used  the  PUR  rate  as 
a  measure  of  quality.   As  tne  rate  decreased  the  quality  was 
judged  to  have  increased.   This  was  possible  because  the 
contract  administration  function  is  done  in  house  by  a 
separate  organization  from  the  PCO  sections.   The  Aviation 
Supply  Office  measured  quality  by  inspecting  documents  on  a 
random  basis  and  determining  what  percentage  of  those 
inspected  were  deficient. 

3.  What  measures  of  quality  are  used  outside  of  the  NFCS 
and  can  they  be  applied  to  the  NFCS? 

The  Air  Foi-ce  now  has  a  quality  checking  system  that 

is  an  in-process  system  for  assessing  quality  before  the 

contract  is  awarded.   Some  of  the  concepts  used  by  the  Air 

Force  concerning  items  to  be  checked  for  quality  are  useful 

and  have  been  included  in  the  appendices  of  this  thesis.   The 

Air  Force  system  dees  not,  however,  attempt  to  measure 

quality.   Rather,  it  attempts  to  insure  it  through  mass 

inspection.   For  this  reason,  no  measure  of  quality  used  by 

the  Air  Force  can  be  applied  to  the  NFCS  quality  program. 
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4.  V/hat  specific  methods  should  be  established  to  improve 

the  quality  of  procurement  actions  within  the  liFCS? 

Establishment  cf  quality  control  officers  -within  the 
I'.FCS  is  the  first  step  th'cZ    should  be  taken  to  improve  the 
quality  of  contracts  in  the  system.   These  quality 
professionals  should  use  a  program  such  as  the  three  step 
model  presented  in  this  thesis  to  establish  quality  oriented 
practices,  measure  the  level  of  quality  and  then  constantly 
work  to  improve  on  this  level  of  quality.   After  the 
establ  ishm.en t  cf  the  quality  professionals  and  the 
impleinentat ion  of  a  quality  model,  the  IJaval  Supply  Syster.:s 
Command  should  put  into  place  a  systeru  that  raoves  the  current 
emphasis  of  quantity  in  the  Productive  Unit  Resourcing 
program  to  one  of  quality.   Tnis  could  be  occomplishec  by 
deducting  units  that  fail  to  pass  quality  measures,  using 
decrease  in  the  PUR  rate  to  m.easure  increases  in  quality,  or 
any  other  method  ttiat  is  devised  by  quality  officers  in  the 
MFCS. 

2 .   Recommendations  for  Further  Research 

The  primary  area  for  further  research  is 
establishment  of  precise  mieasures  of  quality  and  the 
development  of  a  model  for  statistical  analysis  that  can 
apply  these  measures  regardless  of  the  organization  of  the 
contracting  activity.   This  effort  would  result  in  a  complete 
quality  program  that  allows  not  only  improver. ents  in  quality 
but  also  a  way  to  measure  the  improvements  and  compare 
different  contractingactivities. 
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APPENDIX  A 

ANALYSIS  OF  PROCUREMENT  QUALITY 

QUESTIONNAIRE  ONE 

This  questionnaire  is  being  used  to  dravy  upon  the  experience  of 
knowledgeable  personnel  in  the  procurement  field.  You  will  be  asked  to 
identify  factors  which,  in  your  opinion,  affect  the  quality  of  those 
procurement  actions  in  the  $100  thousand  to  $1  million  price  range  with 
which  you  are  familiar.  For  purposes  of  this  study,  a  procurement  action 
encompasses  all  activities  required  for  contract  planning,  placement  and 
administraticn. 

The  inforraation  you  provide  will  be  used  to  structure  a  secona 
questionnaire  designed  to  rank  these  factors  in  order  of  their  perceived 
relative  impact  on  the  quality  of  a  procurement  action.  This  second 
survey  will  be  mailed  to  a  different  set  of  procurement  personnel.  Your 
time  and  effort  in  completing  this  questionnaire  are  deeply  appreciated. 

1.  Under  each  of  the  following  contract  phases,  list  those  tasks  v;hich 
you  feel  are   required  to  ensure  that  a  procurement  action  will  be  a 
"good"  one. 

a.  Contract  planning/pre-award  phase 

b.  Contract  award  phase 

c.  Contract  administration  phase 

2.  Describe  the  qualities  (e.g.,  education,  experience,  etc.)  a  good 
procurement  office  should  possess.  If  certain  qualities  are  required  by 
the'  type  and  complexity  of  the  contracts  handled,  please  note  this  fact. 

3.  Procurement  policies  and  procedures  are  specified  in  Air  Force 
directives  and  the  ASPR.  If  you  feel  that  any  of  these  directives  impede 
your  obtaining  a  "good"  procurement  action,  briefly  describe  the 
directive  and  outline  your  recommendation  for  change. 

4.  For  procurement  actions  with  which  you  are  familiar  and  which  you 
would  describe  as  "bad"  procurement  actions,  list  the  characteristics 
which  in  your  opinion  contributed  most  to  the  unsatisfactory  outcomes, 

5.  What  was  the  worst  procurement  problem  you  experienced  curing  the 
past  year  (other  than  inflation)?  What  single  action  or  lack  of  action 
contributed  most  to  the  problem? 

6.  What  was  the  single  best  procurement  action  you  were  involved  in 
during  the  last  year?  What  were  some  of  the  important  things  which  made 
this  procurement  outstanding? 
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How  iTiany  years'  experience  do  you  have  1r  the  procurerent  field? 

Circle  each  functional  area  in  which  you  have  had  procurement  experience 

(a)  Procurement  of  services       (c)  Contract  administration 

(b)  Procurement  of  supplies       (d)  Other  (specify) 

7.  Based  on  your  experience,  describe  the  attributes  or  qialities  of  a 
good  procurement  action. 


APPENDIX  B 

ANALYSIS  OF  PROCUREMENT  QUALITY 

QUESTIONNAIRE  TWO 

ANALYSIS  OF  PROCUREMENT  QUALITY 

This  questionnaire  is  the  second  in  e  series  of  tv;o  questionnaires 
which  are  designed  to  identify  and  rank  factors  which  affect  the 
overall  quality  of  procurement  actions  in  the  $100  thousand  to  $i 
million  price  range.  In  the  first  survey,  a  random  selection  of  150 
procurement  supervisors  were  asked  to  list  factors  which  they  felt  had 
a  significant  impact  on  procurement  quality.  In  this  survey,  you  will 
be  asked  to  use  your  experience  to  rank  these  factors  in  order  of  their 
relative  importance. 

For  example,  suppose  the  following  evaluation  had  been  made  of 
those  factors  during  the  procurement  planning  phase  which  may  effect 
the  quality  of  the  resulting  procurement  action. 


Less  Importance  to  Ensure  Greater  Importance  to  Ensure 

a  Quality  Procurement  a  Quality  Procurement 


.1  9  \  3 


7 

10 


1.  Clear  statement  of  item/service  required,  precise  drawings, 
reasonable  delivery  schedule,  etc. 

2.  Removal  of  unnecessary  embellishments  from  item/service  required 

3.  Close  coordination  between  procurement  team  and  custoirier  during 
contract  planning  phase. 

4.  Technical  experts  consulted  during  design/specification  of  the 
requirement. 

5.  Accurate  price  estimates  computed. 

6.  Select  proper  type  of  contract  for  the  procurement. 

7.  Adequate  funding  available  in  customer's  budget. 
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In  the  above  evaluaticr,  the  respondent  considered  Factor  1  (clear 
statement)  to  be  of  great  importance  to  obtaining  a  quality 
procurement,  and  it  was  more  important  than  Facicr  7  (adequate 
funding).  Factor  2  (removal  of  embellishments)  v/as  considered  to  be  of 
less  importance  ihan  any  of  the  factors.  Note  that  the  respondent 
coula  distinguish  no  significant  difference  between  Factors  5  (accurate 
price  estimates)  and  6  (selecting  type  of  contract)  so  he  placea  them 
at  the  same  point  on  the  scale. 


PROCUREMENT  PLANNING  PHASE 

Less  Importance  to  Ensure  Greater  Importance  to  Ensure 

a  Quality  Procurement  a  Quality  Procurement 


1.  Clear  statement  of  item/service  required,  precise  drawings, 
reasonable  delivery  schedules,  etc. 

2.  Removal  of  embellishments  from  item/service  required  which  are 
unnecessary  to  meet  performance  specifications. 

5.  Close  coordination  between  procurement  team  and  customer  during 
contract  planning  phase. 

4.  Technical  experts  consulted  during  design/specification  of  the 
requirement. 

5.  Accurate  price  estimates  computed. 

6.  Select  proper  type  of  contract  for  the  procurement. 

7.  Adequate  funding  available  in  customer's  budget. 

8.  Other 
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FORMALLY  ADVERTISED  PROCUREMENT 

Less  Importance  to  Ensure  Greater  Importance  tc  Ensure 

a  Quality  Procurement  a  Quality  Procurement 


1.  Clear,  unambiguous  IFB. 

2.  Maintenance  of  current  list  of  responsible  contractors. 

3.  Conduct  pre-cward  survey  of  responsive  bidders. 

4.  Investigation  of  responsive  contractors'  past  performance  on 
similar  procurements. 

5.  Preparation  of  a  contract  which  contains  required  clauses  and  is 
fair  to  both  parties. 

6.  Other 


NEGOTIATED  PROCUREMENT 

Less  Importance  to  Ensure  Greater  Importance  to  Ensure 

a  Quality  Procurement  a  Quality  Procurement 


1.  Pre-negctiation  strategy  conference  to  eliminate  confusion/ 
differences  within  the  procurement  team,  and  to  establish  a  sound 
negotiating  position. 

2.  Conduct  "Should  Cost"  analysis. 

3.  Clear,  unambiguous  RFP/RFQ. 

4.  Conduct  pre-award  survey  of  possible  contractors. 

5.  Preparation  of  a  contract  which  contains  required  clauses  and  is 
fair  to  both  parties. 

6.  Other 
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CONTHACT  MUiMlMSTRATION 

Less  importance  to  Ensure  Greater  Impcrtcnce  "co  cr.sure 

d  Quality  Procurement  a  Quality  Procurement 


1.  Post-Award  conference  with  contractor,  PCG,  ACO,  and  customer  to 
ensure  unaerstanding  of  responsibilities  of  all  parties  to  the 
contract. 

2.  Rapid  response  to  contractor  queries. 

3.  Ensure  PCu  ana  ACu  present  united  front  to  contractor. 

4.  Failure  of  ACO  to  strictly  enforce  contract  provisions. 

D.  cdrly  recognition  ot  contractor's  proolenis  in  meeting  contract 
provisions . 

6.  Keep  lines  or  communication  optn  among  PCO,  ACO,  ContraLtor, 
customer. 

7.  Thorough  audits  of  contractor. 

8.  Effective  inspection  of  goods/services  provided  by  contractor. 

9.  Other 


CENTRAL  FACTORS 

Currently  has  Adverse  Currently  has  Favorable 

Effect  on  Obtaining  Effect  on  Obtaining 

Quality  Procurements         No  Effect  Quality  Procurements 


A.  Legal  requirements  set  forth  ifi  mSPR/ Procurement  hteg^  with  regard 
to  social  c  icuses/directed  sources  (e.g.  Small  Business  Setasides). 

B.  Outside  political  forces  brought  to  bear  on  procurement  managers. 

C.  Use  of  life-cycle  costing  as  a  criterion  for  contract  award. 

D.  Turnover  rate  of  procuremient  managers. 

E.  Use  of  purchase  price  alone  as  criterion  for  contract  awara. 

F.  High  level  of  competition  for  government  contracts. 
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G.   Infusion  into  procurement  management  positions  of  personnel  vyith 
inaaequate  orocurenent  experience. 

H.  Well  docuniented  procurement  package. 

I.  Open  lines  of  communication  among  PCO,  AGO,  contractor, 
customer. 

J.  PCO's,  ACO's  assigned  too  many  contracts  to  handle  each 
effectively. 

K.  Failure  of  Government  to  mieet  one  or  more  provisions  of  the 
Contract. 

L.  The  number  of  supporting  documents/forms  required  to  complete  a 
procurement  action. 

M.  Layering  of  supervisory  personnel  in  the  procurement  system. 

h.     Use  of  uesign  to  cost  procurements. 

0.  Unnecessary  reliance  on  sole  source  procurements  when  CumpetiLors 
cuulo  be  founc. 


MEASURES  OF  QUALITY 

ineffective  Pleasure  of  Gverell         tTrective  r-ieasure  of  Uverai 
Procurement  Quality  Procurement  Quality 


1.  Number,  reason,  source  of  contract  modifications. 

2.  Contractor's  meeting  of  delivery  milestones. 

3.  Under  cost-plus  contracts:  comparison  of  initial  cost  estimates 
vs  final  cost  to  government. 

4.  Customer  satisfaction  with  good/service  delivered  by  contractor. 

5.  Other  (specify) 
Please  enter  your  MAJCOM. 
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APPENDIX    C 


SMALL   PURCHASE  REVIEW  SHEET 


AWARO  NO. 


AWARO  OATC 


AWARO  VALUE 


PRIORITY 


TYPt  Of  AWARD 


□    CONTRACT         n    P.O.  UNDER  BOA       D  OTHER 


C0NTt»AC7O« 


RCVIEWCR 


OATC 


1.   GENERAL  INFORMATION 


BUYER 


CONTRACTING  OPFICER 


lUVINC  SECTION 


MATERIAU'NSN 


I  QUANTITY         j     UNJT  PRICE  DELIVERY  SCHEDUl 


2.  METHOD  OF  SOLICITATION 


COMPETITION 
□  COMPETITIVE 


n    SOLE    SOURCE 


SYNOPSIZEO 

□  NOT  REQ'O  n  YES         Q  NO 


OD   FORM    I  155 

□    FORM   CURRENT 

n  PROPERLY    FILLED  OUT 


REPETITIVE 
PROCUREMENT 


□  YES       0^*0 


FAST  PAY 

□  YES        "D   NO  n  PROPER 

□  APPROPRIATE   3L0C)C   CHECKED    (BLQCX    16) 


DO   FORM   251 

□  NOT  REQT3 


AACauATT 

Qyes  Qno 


NAVMAT   FORM   ^380/ 
n»ALL  BUSINESS  SET-A5 

Dlasor  surplus  set-as 

□  ho  SET-ASIOE 

□  mot  rewired 

□  reviewed  3y  pco 


3.  SOURCE  OF  SELECTION  AND  COMPETITION 


NO.SOUCITED 


NO. OFFERS  REC'D 


AWARDED  TO 

□  SMALL  BUSINESS        Q   LARGE  BUSINESS  Q  OTHER 


UST  OF  TENDER; 
n    YES   n  NO 


4.  PRICING 


PRICE  COMPETITION 

□  YES    □  NO 


DOCUMENTED  PRICE  ADEQUATE 

ANAUYSIS  Q    ^Q-p  pgQT-,    Q  YES    □    NO 


PRICE  COMPETITION 

nNOTREQTJ 


COST  PRICING  DATA 

□  NOT  R EQ-O       D  YES    Q  NO 


PRE-NECO.    NEHO  ADEQUATE 

□  notreq'd        n  yes    Qno 


ADEQUATE 

D  YES  n  N 


NEGOTIATION    CONDUCTED 

Dyes        Qno 


PRICE  NECO.  MEMO. /0OajH£J*TATl  ON  AOEQUATZ 

00   FORM    178'+  n  NOTREQ'D       D  Y£S       □   NO 


REVIEW  AND  APPROVAU  ADEQUATE 

OF  PRICE  INCREASES 


□  NOT  REO'D     □  YES     □  NO 


5.  PROCUREMENT  HANDLING 


PR  MATERIAL   DESCRIPTION 

□  NOTREQ'D 

ADEQUATE 

□  YES  D    NO 


DO  FORM  330 

□  NOT  REQ'O 

ADEQUATE 
n  YES      n    NO 


ORB    REVIEW /APPROVAL. 

□   NOT  REO'D 
n  YES       n  NO 


FILE   DOaiHEMTATION 

n  COMPLETE 
n  INCOMPLETE 


FUNDS 
AVAIL>VSL£ 


n  YES  n  Ml 


6.  PROCESSING  TIME 

1 

DATE  PR  HEC-U   IN    PG 

DATESOUCITEO/ORDER    PLACED 

DAYS  REQ'O  TO  SOUOT 

OPENING/CLOSING  DATE                 1 

DATE   AWARDED 

BUYER  PROCESaiNG  TIME 

PALT 

PACT  GOAC  MET 

□  YES     n  NO 

CONTRACTOR'S  QUOTE          1 
DATE   RECEIVED                     1 

□  PRICED 

□  UNPRICED 

□  DELEGATED 

DATE  OF   OEFINITIZATION 

REMARKS 


ASC-4a55/2    U-36) 
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LARGE   PURCHASE  REVIEW  SHEET 


AWARO  NO. 


AWAnO   OATE 


AWAHO  VALUE 


PRIORITY 


TVPE   OF    AWARO 


□  CONTRACT    □  D.O.  UNDER  BOA   Q  OTHER 


CONTftACTOR 


REVIEWER 


1.    GENERAL  INFORMATION 


BUYER     CODE/IAME 


CONTRACTING   OFFICER 


BUYING  SECTION 


MATERIALyNSN 


QUANTITY 


UNIT  PRICE 


DELIVERY  SCHEDULE 


2.   METHOD  OF  SOLICITATION 


ACQUISITION:     PCAN 

□  YES         Q    NO  n    NOT  REG'D 


COMPETITlOU 

□  COMPETITIVE 

n  SOLE  SOURCE 
J  S  A  PROPER  □  YES      D  '^0 


SYNOPSIZEO 

n  NOT  REQ'D  n  YES         D  NO 


FOB    ORIGIN:  Q  yes  Q  NO 

DFOa  ORIGIM   W/OIFFERENTIAL   CLAUSE 
DTAC   CODE   ASSIGNED 


IF  NEGO..  AUTHORITY 

10  U.S.C.  2304(  )     C 


)  C       ) 


HAVMAT   FORM   14380/  I 
DSHALL   BUSINESS  SET-ASIOE 

Clabor  surplus  srr-AsiOE 

QNO  Srr-A5IDE 
n  NOT  REQUIRED 
D  REVIEWED   BY    PCO 


N£GO>.  AUTHORITY  PROPER 

Q  YES       n  NO 


in 

z 

UJ 

a. 
X 

UJ 

H 
Z 
UJ 

z 
a: 
u 
> 
O 

o 

< 

a 

UJ 

u 

3 
Q 
0 

0. 
UJ 

a: 


3.  SOURCE  OF  SELECTION  AND  COMPETITION 


NO.  SOLICITED 


NO.  OFFERS  REC'O 


AWAROEO  TO 


n  SMALL  3US1NESS        Q   LARGE  BUSINESS  Q  OTHER 


LIST  OF  TENDERS 

n  YES  n  NO 


4.  PRICING 


PRICE  COMPCTITION 

n  YES    □  NO 


DOCUMENTED  PRICE 
ANALYSIS 


ADEQUATE 

□  NOT  REQt)  □  YES  Q  NO 


CRB    REVIEW/ APPROVAL 

QNOT  REQ'D 


ADEQUATE 

QyES   n  NO 


COST  PRICING  DATA-UTILIZED    PROPERLT 

□   NOT  REQ'D       n  YES    Q  NO 


PRE-NECO.    MEMO 

□  NOT  REQ'D 


ADEQUATE 

□  YES       n  NO 


CERTIFICATE  OF  COST  AJID  PRICING  DATA 

RECEIVED  Dyes         Qno 


PRICE  NEGO.  MEMO. 

D   FORWARDED  TO    DCAA/ACO 


ADEQUATE 

□   yes        □    NO 


REVIEW  AND  APPROVAL  ADEQUATE 

OF  PRICE  INCREASES 


□  NOT  REQ'D     QYES     □  NO 


5.  PROCUREMENT  HANDLING 


PRE-AWARD  SURVEY  OR  WAIVER 

□  NOT  REQ'D 

ADEQUATE 

□  YES  □   NO 


DO  FORM  3Sa 

□  NOT  REQ'D 

ADEQUATE 

□  YES    n  NO 


LEVEL  HIGHER  APPROVAL 

□  NOT   R^Q'D 

□  YES       □  NO 


SURVEILLANCE  CRITICALITY 
DESIGNATOR  PROPER 

□  NOT  REQ'D 

Dyes     D  no 


FUNDS 
AVAILABLE 


□  yes  □  NO 


6.  PROCESSING  TIME 


DATE  PR  REC'O   I II    PG 


DATE  SOLICITED /ORDER    PLACED      DAYS  REQ'D  TO  SOLICIT 


OPEMIHG/aOSIMG  OATE 


OATE  AWARO 


BUYER  PROCESSING  TIME 


PALT  COAL  MET 

□  yes      □   NO 


COITRACTOR'S  PROPOSAL 
DATED - 


n   PRICED 

n  UNPRICED 
n  DELEGATED 


DATE  OF   DEFIMITIZATIOM 


XUHBER  OF   DAYS  TO   DEFINITIZE 


REMARKS 


A5u-4Bb3/j    {Z-'6b) 
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APPENDIX  D 


QUALITY  CONTROL  REPORT  FOPMAT  SyALL   PUPCHASKS 

From:   PG-OA 
To:     PG-A 

Subj:   PROCUREMENT  QUALITY  CONTROL  PROGRAM  (SMJ^LL  PURCHASE) 

Er.cl:   (1)   Statistical  Suinmary  by  Discr<=pancy  Level 

(2)  Statistical  Sumr.ary  by  Section 

(3)  Discrepancies  within  Sections 

1.  This  report  covers  the  review  of  30  small  purchases  made  durine  DerpTrber  I'^Fj, 
Two  folders  were  reviewed  from  each  section,  with  the  exception  of  P<"-y7  and  PGMIC, 
from  which  five  folders  each  were  reviewed. 

2.  The  objective  of  the  report  Is  to  review  and  analyze  small  purch?se<?  ^cr 
discrepancies  and  to  use  data  to  assess  and  improve  auality.   Discrepancies  are 
categorized  into  groups  and  the  groups  are  then  assigned  we:!chts  to  obtain  an 
overall  'discrepancy  level'. 

3.  The  discrepancy  level,  calculated  as  discussed  in  enclosure  (I),    on  this 
review  compares  to  the  last  two  reports  as  follows: 

OCTOBER  NOVE>ffER        DECE^EP 

PGB 
PGM 

TOTAL 

The  overall  quality  level  for  this  report  shows  a  decrease/increase  over  the 
previous  report.   The  reasons  for  this  change  can  be  attributed  to... 

A.   Statistical  summary  of  discrepancy  levels  is  shown  in  enclosure  d)  .      A 
summary  of  statistics  by  section  is  shown  in  enclosure  (2). 

(The  remainder  of  the  report  should  Include  a  discussion  of  each  type  of 

discrepancy one  paragraph  for  each  discrepancy.   The  final  paragraph  should 

include  a  summary  V7hlch  may  or  may  not  provide  recommendaitons  for  improvement.) 
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ACOUISITTON  DUALITY  CONTROL 
SMALL  PURCHASE  REPORT 
PERIOD  REPORT  DATE 


DISCREPANCY 

BY   GROUP 

FOLDERS 

%   OF   FOLDER? 

DTSCTJF-PANCY 

SEC             RFVIE^^?ED 

DEFICIENT 

DEFICIENT 

I             TT           ITT 

T.FT.'n 

Pf:?-2 

PGB-3 

PG?-^ 

PGB-6 

- 

PGP-8 

PGP-]? 

PGM-l 

PGM- 5 

PGM- 7 

PGB-9 

PGM- 10 

PGM- 1 1 

TOTAL   PGP 

TOTAL   PGM 

TOTAL   PG 

*Dlscrepancy  Level  is  calculated  bv  assigning  weights  of  10,  5,  and  1  to 
dlscrepancv  groups  I,  II,  and  III  respectively.   The  weight  is  multiplied 
bv  the  number  of  discrepancies  in  each  group  and  totaled.   The  total  is 
then  divided  bv  the  number  of  folders  reviewed. 


QUALITT  CONTROL  REPORT  FOPJ^T  LAFGE  PURCHASES 

1.  (The  first  portion  of  the  Quality  Control  Report  for  Laree  Purchases  should 
consist  of  an  introduction  and  an  over^'iew  of  the  findings  including  anv  signif- 
icant trends  in  deficiencies.) 

2.  The  second  portion  of  the  report  should  include  a  detailed  list  of  the 
deficiencies  which  were  found  and  will  be  provided  in  the  followire  format : 

Section  Contract  •''' 

Detailed  description  of  the  discrepancy  which  v^as  found. 

Ey ample: 

PGB-12  85-C-OrO] 

1.  The  price  reasonableness  determination  is  based  on  the  instant  nrice 
being  in  line  with  theprevious  award  price.   Whenever  such  technicue  Is 
used,  the  basis  for  determining  the  prior  (base)  price  reasonable  sb.ould 
he  documented. 

2.  Item  B13  of  DD  Form  350  shold  have  been  coded  '3'  rather  than  '3'. 

PGM-9  85-C-9999 

1.   The  Contracting  Officer's  signature  block  on  the  NAVMAT  Forrr  4380 
was  not  properly  completed. 

3.  The  detailed  deficiency  listing  will  be  followed  by  a  section  which  provides 
a  list  of,  first,  all  the  contracts  reviewed  which  contained  a  deficlenc-  and, 
second,  all  the  contracts  reviewed  which  contained  no  deficiencies.   The.=  o  'ists 
will  include  the  Contract  No.,  Buyer,  Contracting  Officer  and  Section  Head. 


APPENDIX  E 


r 

FILE  INDEX  POSITION  I 

NSC    NORVA    4280/6     (New    6/86) 


CONTRACT  FILE  KDEX 


POSITION  I  PRE-SOUCITATION 

REQN  &  SUPPORTI25G  DOCJMENTS   (E.E.  DD254,  DDI423  W/TDID's  &  SS  STAHMDri) 

REQUEST  FOR  ADDITIONAL  INFCRMATION/ INADEQUATE  SPECS,   ETC. 

FUNDING  DOaiMENT  (IF  SEP.ARAIE  FROM  REQN) 

SPECIAL  APPROVAL  DOCUMENTS   (I.E.   GSA/ADP) 

SPECIAX  APPROVAL  DOCJMENTS   (I.E.  DIPEC/CSS) 

TEOiNICAL  E^/ALUATION  PLAN(SaRCE  SELECTION  PLAN) 

BIDDEIIS  MAILING  LIST 

SMALL  BUSINESS /SMALL  DISADVANTAGED  BUSINESS  RF/IEW  SHEET 

S'iJWPSIS  (OR  JUSTIFICATION  FOR  NOT  S'fNOPSIZING) 

MISC  DETERMINATIONS  AJO  MEMORANDUMS 

SELECTION  OF  ACQUISITION  PROCEDURE  MEHD 

ORAL  SOLICITATION 

JUSTinCATICN  5<  APPROVAL  ,'.■/■:...;/..■.. ;.:",■ 

TYPE  OF  CONTRACT  ./rj...:-i.'ir.-::-r. -:'.■..- 

CONFUCT  OF  INTEREST  (REQUEST  FOR  USE) 

■ CONFUCT  OF  INTEREST  (APPROVAL  FOR  USE) 

OPTION  (  USE  &  r/ALUATION) 

OVERTIME  (REQUEST/ APPROVAL 

SPECIAL  WARRANTY 

PERSONAL  VS  NON-PERSONAL  SER^/ICES  QUESTIONNAIRE 

PRE-PRDPOSAL/PRE  BED  CONFERENCE 

DESCRIPTIVE  LIiniATLRE  MEM) 

aiALL  BUSINESS/UBCR  SURPLUS  AREA  SET-ASIDE 

USE  OF  LIQUIDATED  DAMAGES 

WAIVER  OF  ADMIN  PLAN/RETENTION  OF  ADMIN 


DOL  WAGE  DEmSMINATION  (SID.   FORM  98) 

8(a)   PROCUREMENT  REQU^EST 

8(a)   PRCCUREME^n:  JUSTTFICATI0N/AUTK3RIZATI0N 

F^S  PROaREMENT  SUPPORT  DATA 

ACC^SITION  TRACING  CHART 

CLAUSE  CKEC^C  SHEET/ SOLICITATION  ROUGH  DRAFT 

CONTRACT  RE^/IEW  BOARD  PRE-SOLICITATTON  SUJ^ARY 

KO/LEGAL/R£:/IZw  BOARD  .APPROVAL  SHEET 

EXTEISiaN  OF  OFFERS 

PREVIOUS  CONTRACT  HISTCRY 


89 


NSC 


r 

V 
FILE  INDEX,  POSITION  II 
NORVA  4280/3  (New  6/86) 


r 


CONTRACT  HLE  IMDEX 


POSITION  II 


PRE-AW;^ED 


ORIGINAL  SOLICITATION  AND  AMENDMENTS 

REQUESTS  FOR  SOLICITATION  DOCUMENT 

OFFERS  (LOCATOR  SHEET) 

NO  OFFER  RESPONSES 

ABSTRACT  OF  BIDS/OFFERS 

LATE  BID  MEMD  AND  LETTERS 

MISTAKE  IN  BID  DETEEMINATTON 

TECHNICAL  EVALUATIONS  (REQUESTS) 

TECHNICAL  EVALUATIONS  (RESULTS) 

AUDIT  (REQUESTS) 

AUDIT  (RESULTS) 

FRE-AWARD  SURVEY  (REQUESTS) 

FRE-AWAED  SURVEY  (RESULTS) 

LETTERS  TO  UNSUCCESSFUL  OFFERORS 

REQUESTS  FOR  EXTENSION  OF  PROPOSALS 

PRICE  AND  COST  DATA/COST  AND  PRICE  ANALYSIS 

FRE-NEGOTTATTON  BUSINESS  CLEARANCE 

CERTIFICATE  OF  CCM'ETENCY  (REQUEST  &  RECEIPT) 

FREICSTT  COST  E^/ALUATTON 

EEO  COMPLIANCE  (REQUEST) 

EEO  CCMPLIA^K2  (APPROVAL) 

SUB-CONTRACT  PLAN  (WAIVER/ APPROVAL) 

RECORD  OF  NEGOTIATIONS 

BEST  AND  FINAL  OFFEP.S  (REC^JESTS /RESPONSES) 

SB  SIZE  PROTEST  LETTER  (OR  WAIVER) 

2ND  BEST  AND  FINAL  OFFERS  (PvEQUESTS /RESPONSES) 

CERTIFICATE  OF  CURRENT  COST  OR  PRICI2C  DATA 

2ND  ABSTRACT  OF  BIDS  OFFERS  OR  ADDITIONAL  ABSTRACTS  OF  BID  0FFI2S 

PRICE  Ai^©  COST  ANALYSIS  OF  BEST  AND  FILIAL  OFFERS 

ADDITIONAL  FUNDS  AUTHORIZATION 

PRDTEST(S)  BEFORE  AWARD 

POST-NEC-OTTATTON  BUSINESS  CLEARANCE  OR  NEGOTIATORS  MEMORANDUM 

SHOWING  DETAILED  RESULTS  OF  NEGOTIATION  IN  EVENT  PRE-NEG0TIATTC3 

OBJECTIVES  ARE  MET 

DETERMINATION  THAT  CONTRACTOR  IS  RESPONSIBLE 

AWARD  PREPARATION  SHEET 

REVIEW  BOARD  APPP^lVAL  FOR  AWARD 

CHINFO  NOTIFICATION  (FOR  AWARDS  OVER  $3,000,000  and  release  letter) 
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FILE    INDEX,     POSITION    II. 
NSC    NORVA    4280/4     (New    6/86) 


CONTRACT  FILE  INDEX 


POSITION  III  CONTRACT  AWARD  &  MDDIFICATIONS 

203  HISTORY  OF  INCOIDC  DOCUMENTS 

MESSAGE  AWARD 

CCNTRACTDR"S  ACCEPTANCE  OF  AWARD) 

SYNOPSIS  OF  AWARD 

NOTIFICATION  OF  AWARD  ID  LOCAL  CCMRACTOR 

SIQtED  CCmRACT 

CanRACT  DISTRIBUTION  SHEET 

MDIFICATION  LIST 
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Code  201 

Test   Fora  86-5 


CONTRACT  FILZ  INDEX 


POSITION  IV  CCx^lTRACT  ADMINISTRATION 

MEIID  ID  BASE  POUCE  IF  SERVICES  ARE  TO  BE  PERFOR>!ED  ON  BASE  -  ■ 

DCASMA/DCAA  BUSINESS  CLEARANCE  TRANSI-aiT.^L  LETTER 

BAQGXG  STATUS  SHEET 

DD350 

CONTRACT  FILE  CHEGC  SHEET 

CONTRACT  ADMINISTRATION  PIAil 

COTR  DESIGNATION  LETTER(S) 

POST-AWARD  CONFERENCE  REPORT 

DEBRIEFING  OF  UNSUCCESSFUL  OFFERORS 

NOTICE  OF  ASSIGNMENT 

NOVATION  AGREEMENT 

FINAL  DD250 

TERMIlNlATION  (NO  COST/CONVENIENCE/DEFAULT)  DOCUMENTATION 

BUSINESS  CLLAR.ANCE  OR  ME^CRANDUM  JUSTIFYING  EXERCISE  OF  FIRST  YEAR 

OPTION  (INCLUDIM;  BACKUP  DOa^MENTATION) 

BUSINESS  CLEARANCE  OR  MEMORANDUM  XSTTFYI^  EXERCISE  OF  SECOND  YEAR 

OPTION  (INCLUDING  BACKUP  DOafMENIATTON) 

PROTEST  AFTER  AIvARD 

NOTICE  TO  EMPLOYEES  LETTER  TO  CC'NTRACTOR 

DOL  NOTIFICATION  OF  AIVAED 

LETTER  REQUESTTI^G  REGN.  FOR  FOLLOW-ON 


CONTRACT  COMPLETION  DCa^ENTS 
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APPENDIX    F 


CONTRACT    NUMBER 
CODE    201 ." 


NA 


CODE  201 
-"     CONTRACT  FILE  CHECK  SHEET 
(TO  BE  FILED  IN  POSITION  FOUR) 

GENERAL  

1.  Contract  Number,  Delivery  Order  No.,  Task  Order  No.  in  large 
legible  numbers  in  upper  right-hand  corner  of  jacket.  

2.  Complete  2  TICKLER  CARDS.   Tickle  Date:  10  days  before  delivery 
for  supplies.   45  days  after  completion  for  services.  


YES 


NO 


3.   Complete  2  OUTSTANDING  CONTRACT  RECORD  CARDS  for  all  Contracts; 

annotate  with  contractors  name,  number  of  options  and  how  long 

from  PR  receipt  to  award.  


U.      Complete  HISTORY.  FILE  CARD. 

5.  Complete  COMMODITY/ SERVICE  CARD. 

6.  Copy  of  BUSINESS  CLEARANCE(S)  in  BC  File. 

7.  If  "Availability  of  Funds"  Clause  applies,  attach  note  to 
front  of  jacket. 

POSITION  1: 


1.   All  MEMOS  signed  and  dated  by  Contracting  Officer,  Legal, 

Small  Business  Specialist,  Deputy  Competition  Advocate,  and/or 
Chief  of  Contracting  (as  applicable):  


a.  Determination  i  Findings 

b.  Oral  Solicitation 

c.  Justification  &  Approval 

d.  Authority  to  Negotiate  (RAN) 

e.  Type  of  Contract 

f.  Option  (Use  &  Evaluation) 

g.  Special  Warranty 

h.  Personal  VS  Non-Peraonal  Services  Questionnaire 

i.  Contracting  Officer's  Sole  Source  Justification 

j.  Fostering  Competition 

k.  Pre-Proposal/Pre  Bid  Conference 

1.  Small  Business/Labor  Surplus  Area  Set-Aside 

m.  Use  of  Liquidated  Damages 

n.  Waiver  of  Admin  Plan/Retention  of  Admin 

o.  Deputy  Competition  Advocate  Approval  for  Sole  Source 
Procurement 

2.  ONE  copy  of  complete  REQUISITION  PACKAGE  with  PUR-A, 
Funding  Documentation  and  Applicable  Approval  documents. 

3.  Records  of-  Conversation  signed  and  dated  with  names  of 
persons  spoken  with  and  telephone  numbers. 
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CONTRACT  NO.  N00ia9- 


CONTRACT  FILE  CHECK  SHEET  -  PAGE  2 


NA.   YES    NO 


4.  Complete  solicitation  MAILING  LIST. 

5.  Copy  of  SYNOPSIS,  or  justification  for  not  synopsizing. 

6.  Ensure  that  lines  of  accounting  on  accounting  sheet(s) 
and  requisition  are  the  same  and  are  the  correct  type  of 
n>oney . 


POSITION  2:  .; 

1.  ONE  copy  of  each  UNSUCCESSFUL  OFFERORS '/bidders '  proposals/ 
bids.   (If  file  is  too  bulky,  these  proposals/bids  should  be 
placed  in  a  separate  folder.) 

2.  Envelopes  of  LATE  BIDS  stamped  and  signed  by  Bid  Opening 
Officer  with  applicable  memos  and  letters  to  late  bidders. 


3.  ALL  MEMOS  signed  and  dated  (i.e.  Determination  of  Responsibility, 
pricing  memos,  business  clearances).  

4.  Official  copy  of  signed  ABSTRACT  (DO  NOT  MARK  ON  OFFICIAL  COPY. 
Any  corrections/mistakes  on  official  copy  are  to  be  initialed 

by  Bid  Officer).  


5.   FOR  SET  ASIDES:  Letters  to  unsuccessful  offerors  or  waiver 
of  letter  to  unsuccessful  offeror. 


POSITION  3: 

1.  MESSAGE  AWARD. 

2.  Contractor's  verification  of  receipt  of  message  award. 


3.   ONE  copy  of  contract  with  ORIGINAL  signatures  on  contractor's 
proposal,  amendments,  contract  award,  and  modifications. 


4.   Ensure  contract  is  in  proper  order  (i.e.  pages  are  in  numerical 
order  and  are  right-side-up).  


5.  SYNOPSIS  of  Award. 

6.  Ensure  Attachments/Exhibits  listed  in  Section  J  are  attached 
to  the  contract. 


7.   Ensure  DEPARTMENT  OF  LABOR  WAGE  DETERMINATION  is  incorporated 
(NOTE:   Verify  currency  of  Wage  Determination  prior  to  best 
and  final/award  by  calling  DOL  at  76-523-7581.) 
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CONTRACT  NO.  NOG  189- 


CONTRACT  FILE  CHECK  SHEET  -  PAGE  3 


NA   YES    NO 


8.  Ensure  DD  254  for  SECURITY  CLASSIFICATION  is  completed,  signed, 
dated  with  date  of  contract  award,  and  attached  (DIS  address  is 
used  in  lieu  of  DCASMA  address). 


9.  Ensure  OPTION  YEARS  are  incorporated  into  contract  award 
with  Performance  Periods  identified  with  corresponding  line 
items . 

10.  If  burden  rate  applies  to  "Other  Direct  Costs,"  ensure 

that  applicable  rate  is  incorporated  into  award  Modification 
List  (ON  TOP). 

11.  Ensure  SUBCONTRACTING  PLAN,  if  required  is  included 
in  contract  award. 


12.  Ensure  CONTRACT -'ADMINISTRATION  PLAN  is  incorporated  by 
reference  in  the  contract  award. 

13.  Incorporate  COMPLETE  DISTRIBUTION  LIST  into  contract  . 
award. 

14.  Contract  support  division,  HISTORY  OF  INCOMING  DOCUMENTS 
form. 

15.  CONTRACT  DISTRIBUTION  SHEET. 


PLEASE  NOTE:   NO  Records  of  Conversations,  price  lists,  descriptive 
literature,  etc.  are  to  be  filed  in  POSITION  3...   Any  information  received 
prior  to  award  is  to  be  filed  in  POSITION  2  in  chronological  order...   Any 
information  received  after  award  is  to  be  filed  in  POSITION  4  in  chronological 
order. 


POSITION  4: 

RESERVED  FOR  CORRESPONDENCE /ACTION  AFTER  CONTRACT  AWARD 


1-   PUR-P  CARDS  pulled  and  notation  of  date  pulled  is  on 
jacket . 

2.  BHJ  Cards  completed  and  sent  to  Small  Purchase,  when 
applicable. 

3.  Copy  of  completed  DD  350  with  report  number  in  file;  ensure 
original  in  Code  203  and  notation  of  date  pulled  is  on 
jacket.   (COMPETITION???  Check  Block  18.) 

-4.   COTR  LETTER  signed;  speedletter  sent  to  DCAA  and 
contractor. 
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CONTRACT  NO.  NOG 189- 


CONTRACT  FILE  CHECK  SHEET  -  PAGE  4 


5.  For  MAX  PRICE  B.O.A.  order,  copy  of  apeedletter  to 
DCASMA  for  authorization  and  def initization  of  order. 

6.  Copy  of  Negotiation  Memorandum  sent  to  DCAA,  DCASMA. 

7.  Complete  accounting  line  is  cited  on  modifications 
affecting  contract  price. 

8.  Memo  sent  to  Base  Police  if  services  are  to  be  performed 
on  the  Base. 

THROW  AWAY: 

1.  ROUGH  DRAFT  AND  EXTRA  COPIES  of  solicitation,  keep  clause 
check  sheet. 

2.  ENVELOPES  not  affecting  late  bids. 

3.  White  certified  mail  slip  after  green  slip  received. 

4.  EXTRA  COPIES  OF  REQUISITION. 

5.  Rough  drafts  of  mods  and  amendments. 

6.  Blue  and  pink  typing  set-up  sheets. 


NA-   YES    NO 


NA    YES    NO 


RETAIN: 

1.   Five  extra  copies  of  SIGNED  CONTRACT  AND  MODIFICATIONS. 


NOTE: 


If  Che  file  is  too  bulky,  separate  the  file  into  two,  three,  or  more  jackets  and  mar 
the  outside  of  the  files  as  JACKET  1  OF  2 ,  etc...  and  what  each  jacket  contains. 
Contract  number  is  to  be  in  the  upper  right  hand  corner  of  each  jacket. 


DATE 


Contract  Specialist 


DATE 


Contracting  Officer 
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APPENDIX  G 
SHALL  PURCHASE  QUALITY  REVIEV/  GUIDE 

The  following  items  should  be  checked  v;hen  conducting  a 
quality  inspection  of  small  purchase  documents.   As  a  part  of 
the  quality  review  process,  quality  inspectors  should  also 
review  the  small  purchase  process  to  ascertain  possible 
causes  of  errors.   Section  B  of  this  appendix  contains  areas 
that  might  be  covered  during  this  review. 
Section  A  -  Quality  Checklist 

1.  Is  the  purchase  a  BPA  call,  purchase  order,  or  delivery 
order? 

2.  VJas  it  sole  source  or  competitive? 

3.  Is  the  sole  source  justification  adequate? 

5.  Is  the  document  properly  numbered? 

6.  Are  there  any  material  typographical  errors? 

7.  Are  the  pricing  extensions  correct? 

8.  Is  the  price  reasonable  and/or  justified? 

9.  Does  the  price  match  that  of  the  requisition? 

10.  If  the  price  is  greater,  is  the  file  documented  to 
indicate  that  approval  to  overrun  funds  was  obtained? 

11.  Are  the  specifications  clear? 

12.  Are  they  in  compliance  with  the  requisition? 

13.  If  not,  is  there  documentation  to  support  the  change? 
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14.  If  there  is  a  written  quote  in  the  file,  does  the 

contractual  docur:;ent  agree  with  it? 
T5.  Is  the  paying  office  correctly  noted  on  the  document? 

16,  Is  the  total  award  exceed  $25,000? 

17.  If  the  requisition  exceeds  $10,000,  was  it  synopsizea? 
13.  Is  there  certification  tnat  the  item  is  not  available  in 

the  supply  system? 

19.  Is  the  quantity  ordered  in  agreement  with  tne  quantity 
requested? 

20.  Is  the  purchase  file  complete? 

21.  \-lere    fast  pay  procedures  used? 

22.  Uere  they  properly  followed? 

23.  VJas  tne  award  made  to  a  small  business  or  under  other 
socioeconomic  program? 

24.  VJas  the  award  proper  in  this  respect? 

25.  V/as  the  funding  for  the  purchase  proper  for  the  type  of 
purchase  made? 

Section  3  -  Review  Areas 

The  following  questions  are  typical  of  those  that  should 
be  asked  v-;hen  reviewing  the  small  purchase  process  in  order 
to  determine  problems  and  find  solutions  to  them. 

1.  VJhat  is  the  condition  of  incoming  requisitions? 

2.  Are  incorrect  requisitions  returned  to  the  customer  or 
fixed  by  the  buying  office? 
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3.  Is  there  a  training  program  for  custoraers  that  includes 
requisitions,  as  well  as  other  areas  that  would  allow  them 
to  improve  the  contracting  process? 

4.  Is  tnere  adequate  training  for  all  employees  of  the  buying 
office? 

5.  Are  there  sufficient  controls  in  the  contracting  process 
to  highlight  problems? 

6.  Is  the  activity  experiencing  backlogs  in  any  part  of  the 
process? 

7.  What  are  the  causes  of  the  backlogs? 

8.  What  are  the  document  distribution  requirements? 

9.  Are  these  requirements  being  met? 

10.  VJhat  is  the  cause  of  any  delays? 
Section  C  -  Conclusion 

The  questions  presented  above  are  examples  of  the  types 
of  questions  that  should  be  asked  by  quality  inspectors  to 
find  problems  and  their  solutions.   Questions  should  be  added 
or  deleted  to  meet  the  needs  of  the  activity. 

Another  important  source  of  quality  information  is  the 
employees  of  the  organization.   Many  problems  and  solutions 
can  be  found  by  simply  conferring  with  the  people  closest  to 
the  problem.   This  valuable  source  of  information  should  be 
used  as  often  as  possible  to  ensure  tlie  quality  program  is 
complete. 
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AFPEi.'DIX  H 
LARGE  CONTRACTS  QUALITY  REVIEW  GUIDE: 


The  large  contracts  quality  review  guide  is  siniilar  in 
many  respects  to  the  sraall  purchase  guide.   The  primary 
differences  are  found  in  the  nature  of  tne  processes  (i.e., 
the  simple  process  of  small  purchasing  vs.  the  cor..plex 
procedures  of  large  contracts). 
Section  A  -  Quality  Cne cl<l  is  t 

1.  Do  incoming  requisitions  include  clear  specifications, 
statement  of  worK,  reasonable  delivery  schedule,  adequate 
funds,  etc? 

2.  Are  these  requ  irer;;en  ts  met  by  the  contract? 

3.  Are  there  unnecessary  requirements  in  the  requisition? 

4.  Is  the  requisition  technically  sound? 

5.  Are  accurate  price  estimates  included? 

6.  Is  the  contract  type  chosen  proper  for  the  circumstances? 

7.  If  the  contract  v/as  conducted  under  sealed  bid  procedures, 
was  that  the  proper  choice  under  the  circumstances? 

8.  Are  sealed  bid  procedures  follov^ed? 

9.  V/as  a  pre-award  survey  conducted? 

10.  If  not,  should  it  have  been?  If  so,  was  it  adequate  and 
properly  documented? 

11.  Is  the  completed  contract  fair  to  botn  parties? 

12.  Were  prenegotiat ion  efforts  conducted  and  properly 
documented? 
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13 

14 
15 

16 


17 


18 


19 


20 
21 

22 


23. 


24. 


25. 


V'as  a  "shoulc  cost"  analysis  conducted?   Should  it  nave 

been? 

Is  the  contract  for  goods  or  services? 

If  it  is  for  services,  is  tne  contract  administration  to 

be  conducted  "in  house"? 

Are  requirements  such  as  contractor  audit,  inspection 

program,  quality  program,  etc.  in  place  in  the 

contract/solicitation  and  are  they  being  complied  v;ith? 

Is  there  evidence  of  legal  review  in  the  file,  if 

requ  ired? 

lias  evaluation  of  proposals  conducted  in  acccrdance  v;ith 

the  guidelines  set  forth  in  the  solicitation? 

VJas  the  contract  awarded  competitively?   Should  it  have 

been?   V/'hat  action  is  being  taken  to  ensure  competition 

will  be  obtained  in  the  future? 

Has  the  contract  been  modified  since  award? 

V/ere  modifications  the  result  of  mistakes  made  during  the 

process  of  awarding  the  contract? 

Is  the  final  cost  of  the  contract  in-line  with  the  funds 

provided  on  the  requisition?   Is  there  evidence  of  why 

tnere  were  differences? 

Uas  the  acquisition  plan  completed  if  required?   Is  it 

reasonable? 

V/as  the  award  made  under  a  soc  ic-economiic  prograra? 

V/ere  the  requirements  of  the  program  properly  followed? 

Are  contract  review  board  results  contained  in  the  file? 
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26.  V/as  certification  of  cost  and  pricing,  data  required?   IJas 
it  obtained? 

27.  Vlas  a  DD  Form  350  completed? 

28.  Were  higher  level  approvals  required?  \Jere    they 
obtained? 

29.  V/as  the  contract  awarded  in  a  timely  manner"? 

30.  Uas  a  synopsis  made?   Is  there  a  justification  and 
approval  in  uhe  file  if  it  was  not  made? 

31.  Has  the  contract  been  distributed  in  accordance  with 
current  procedures? 

Section  B  -  Review  Areas 

In  addition  to  those  listed  above,  the  following 
questions  should  be  asked  to  assist  in  finding  and  resolving 
problems. 

1.  Are  there  unnecessary  paperwork  requirements  placed  on 
contract  specialists  that  act  as  barriers  to  their 
performance? 

2.  Is  the  office  workload  to  large  for  the  manning  level? 

3.  Is  the  organization  of  the  office  proper  in  light  of  the 
workload? 

4.  Are  managers  properly  trained  and  knowledgeable  in 
contracting  to  a  level  sufficient  to  properly  perform 
their  duties? 

5.  Is  the  turnover  rate  for  employees  unusually  high? 

6.  Does  communication  between  the  contracting  officer, 
contractor  and  the  customer  seem  to  be  adequate? 
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7.  Are  there  controls  in  place  to  ensure  that  the  contract  is 
complete  prior  to  being  turned  over  to  a  contract 
administration  branch  or  office? 

Section  C  -  Conclusion 

These  questions,  as  well  as  others  tied  to  the  system 

(see  Appendix  G)  should  aid  in  the  problem  finding/solving 

portion  of  an  activity's  quality  program. 
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APPEIIDIX  I 
CUSTOMER  QUALITY  QL'ESTIOIIS 

The  following  are  examples  of  the  types  of  questions  that 
may  be  used  to  judge  the  quality  of  contracts  using  the 
customer's  input.   The  questions  allow  feedback  froin  the 
customer  but  limit  tlie  affect  of  personalities  of  either  the 
cuscomer  or  buyin^:  organizations  on  the  quality  of  the 
feedback.   Questions  such  as  these  should  be  put  into  a 
customer  service  form  that  is  mailed  to  selected  acLivities 
as  a  part  of  the  review  program  for  a  contracting  office. 
Other  questions  may  be  added  to  this  list  according  to  the 
circumstances  betv;een  the  buying  activity  and  its  customers 
(ie.,  fleet  support  vs.  shore  support,  etc.) 

1.  Was  the  (  item./serv  ice )  delivered  on  time  according  to  the 
purchase  request? 

2.  Was  the  purchase  document  in  agreement  with  the  purchase 
request  concerning  specifications?  Delivery  instructions? 

3.  Were  copies  of  the  purchase  document  received  in  a  timely 
manner  from  the  buying  activity? 

4.  V/as  adequate  status  of  the  purchase  provided  to  you  during 
the  time  the  requisition  was  being  processed  by  the  buying 
office? 

5.  Was  the  price  paid  for  the  item  within  the  limits  of  the 
price  on  the  requisition? 
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6.  If  the  price  v/as  greater,  were  you  notified  in  advance? 

7.  Do  you  consider  the  price  to  be  fair  and  reasonable? 

8.  V/ere  problems  that  arose,  if  any,  in  the  process  of 
coHipleting,  the  purchase  resolved  in  a  timely  manner? 

9.  If  the  requisition  was  for  service,  has  the  contractor 
performed  to  the  specifications  of  the  contract? 

10.  If  ncu,  have  problems  been  resolved  by  the  contract 
administration  office  in  a  timely  manner? 

11.  What  recommendations  would  you  make  to  improve  trie 
quality  of  the  next  purchase  the  buying  activity  makes 
for  you? 

These  questions  should  provide  the  contracting  activity's 
quality  control  staff  with  enough  information  to  make  basic 
assessments  as  to  the  quality  of  the  contracting  product  in 
the  eyes  of  the  activity's  customers.   Questions  can  be  added 
or  deducted  based  on  the  responses  received  and  the  need  to 
check  other  areas. 
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